4* 



' -5 

j O 



UTILITY PATENT APPLICATION TRANSMITTAL 

(for Noncontinuing, Nonprovisional 
Applications under 37 C.F.R. §1.53 (b)) 

Attorney Docket No. 63345 



Total Pages: 



A 



Box PATENT APPLICATION 

Commissioner of Patents and Trademarks 

ATTENTION: Assistant Commissioner 

for Patents 
Washington, D.C. 20231 

Sir: 

Transmitted herewith for filing 
under 37 C.F.R. §1.53 (b) is the 
nonprovisional , noncontinuing 
patent application for: 

f 

Title: SYSTEM AND METHOD FOR IMAGE 

COMPRESSION AND DECOMPRESSION 



First Named Inventor or 
Application Identifier: 



CERTIFICATE OF HAILING BY "EXPRESS HAIL 11 
"Express Hail" Mailing Label Number 

E1896102779US 

Date of Deposit 5/11/98 



I hereby certify that this paper or fee is being 
deposited with the United States Postal Service 
"Express Mail Post Office to Addressee" Service 
under 37 CFR §1-10 on the date indicated above and 
is addressed to the Commissioner of Patents and 
Trademarks, Washington, D.C. 20231. 

ED PRICE 



< Typed or 



person mai I ing) 




(X) 766 pages of the specification (including claims) are enclosed. 

(X) 6 sheet (s) of drawings are enclosed. (X) Formal ( ) Informal 

( ) An executed Oath or Declaration and Power of Attorney naming the 
actual inventors is enclosed. 

(X) The names of persons believed to be the actual inventors are set forth 
in the enclosed unexecuted Oath or Declaration and Power of Attorney 
(§1.41 (a) and §1.53 (b) ) . 

( ) An Assignment (s) of the invention to , 

and. cover sheet are enclosed. 

( ) A check in the amount of $ to cover the fee for recording the 

assignment (s) is enclosed. 

( ) A 37 C.F.R. §3.73 (b) Statement is enclosed (where an Assignee seeks 
to take action in a matter before the Patent Office) . 

( ) An Information Disclosure Statement is enclosed. 

( ) A Form PTO-1449 is enclosed. 

( ) References (copies) listed on the Form PTO-1449 are 

enclosed. 

(X) A Return Receipt Postcard is enclosed (MPEP §503) . 



Utility §1.53 (b) -1-1297 



f 



Attorney Docket No. 63345 

(X) Priority of application number 60 / 040241 filed on 

3/11/98 in is claimed under 

35 U.S.C. §119. 

( ) A certified copy of the priority document is enclosed. 
( ) A MicroFiche Computer Program (Appendix) is enclosed. 
( ) A Nucleotide and/ or Amino Acid Sequence Submission is enclosed. 

( ) A Computer Readable Copy is enclosed. 

( ) A Paper Copy (Identical to Computer Copy) is enclosed. 
( ) A Statement Verifying Identity of above Copies is enclosed. 
(X) The filing fee is calculated below: 

Fee Calculation For Claims As Filed 

(a) Basic Fee 

(b) Independent Claims 9 - 3 = _6 x $ 82.00 

(c) Total Claims - 20 - x $ 22.00 

(d) Fee for Multiply Dependent Claims $270.00 

Total Filing Fee 

( ) A Statement (s) of Status as Small Entity is 

enclosed, reducing the Filing Fee by half to: 



$ 


790 


.00 


= $ 


492 


.00 


= $ 


264 


.00 


$ 


$1, 


546 


.00 


$ 


773 


.00 



( ) A check in the amount of $ to cover the filing fee is 

enclosed. 

( ) Charge $ to Deposit Account No. 06-1135. 

(X) The payment of the Filing Fee is to be deferred until the Declaration 
is filed. Do not charge our Deposit Account. 

(X) A separate written request under 37 C.F.R. §1 . 136 (a) (3) , which is 
a general authorization to treat any concurrent or future reply 
requiring a petition for an extension of time under 37 C.F.R. 
§1.136 (a) for its timely submission as incorporating a petition 
for an extension of time for the appropriate length of time, is 
enclosed. 

(X) The Commissioner is hereby authorized to charge any additional fees 
which may be required in this application under 37 C.F.R. §§1.16-1.17 
during its entire pendency, or credit any overpayment, to Deposit 
Account No. 06-1135. Should no proper payment be enclosed herewith, 
as by a check being in the wrong amount, unsigned, post-dated, other- 
wise improper or informal or even entirely missing, the Commissioner 
is authorized to charge the unpaid amount to Deposit Account No. 
06-1135. This sheet is filed in triplicate. 



Utility §1.53 (b) -2-1297 



Attorney Docket No. 63345 



( ) Also enclosed: 



(X) Address all future communications to: 

FITCH, EVEN, TAB IN & FLANNERY 
135 South LaSalle Street, Suite 900 
Chicago, Illinois 60603-4277 
Telephone : (312) 372-7842 
Facsimile: (312) 372-7848 



March 11, 1998 



(Date) 




Registration No. 



34,161 



Utility §1.53 (b) -3-1297 



-1- 

SYSTEM AND METHOD FOR IMAGE COMPRESSION AND DECOMPRESSION 



This application claims the benefit of U.S. 
Provisional Application No. 60/040,241, filed March 11, 
1997, System and Method for Still Image Compression, 
5 which is incorporated herein by reference. 

Field of the Invention 

The present invention relates generally to 
digital image compression/decompression, and 
particularly, to a wavelet-based system and method of 
10 image compression and decompression. 

Background of the Invention 

Nearly every computer user needs to store, 
transfer, and view images. These images include still 
images, or pictures, as well as video images, which are 

15 sequences of still images displayed in a manner that 

depicts motion. The enormous size of image files leads 
to serious file management limitations. For example, a 
single still image (equivalent to a video frame) 
displayed by a rectangular array of picture elements 

20 (pixels) arranged in 640 rows and 800 columns, with the 
color of each pixel represented by twenty-four bits, 
would require over 1.5 megabytes of digital memory to 
store. One solution to this problem is high-quality data 
compression technology. Essentially, image compression 

25 mathematically transforms a grid of image pixels into a 
new, much smaller set of digital values holding the 
information needed to regenerate the original image or 
data file. 

In addition imaging systems, compression 
30 technology can be incorporated into "video on demand" 

systems, such as video servers. Compression technology 
can also be applied to streaming video, which is the 
real-time capture and display of video images over a 
communications link. Applications for streaming video 
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include video telephones, remote security systems, and 
other types of monitoring systems. 

Several standards for compressing real-time 
video currently exist. The H.263 standard for real-time 
5 video is an industry standard based upon the discrete co- 
sign transform (DCT) . DCT is also the basis for both of 
the public domain image compression standards, MPEG 
(Motion Picture Experts Group) and JPEG (Joint 
Photographic Experts Group) . Although the DCT approach 
10 performs interframe coding adequately, its compression 
ratio and speed can be improved upon. 

Various other types of data compression have 
been developed in recent years. Conventional data 
compression techniques are generally referred to as being 
15 either "lossless" or "lossy", depending upon whether data 
is discarded in the compression process. Examples of 
conventional lossless compression techniques include 
Huffman encoding, arithmetic encoding, and Fano-Shannon 
encoding. With a lossless compression, the decompression 
2 0 process will reproduce all bits of the original image. 
Lossless compression is important for images found in 
such applications as medical and space science. In such 
situations, the designer of the compression algorithm 
must be very careful to avoid discarding any information 
25 that may be required or even useful at some later point. 

Lossy compression, in contrast, provides greater 
efficiency over lossless compression in terms of speed 
and storage, as some data is discarded. As a result, 
lossy techniques are employed where some degree of 
30 inaccuracy relative to the input data is tolerable. 
Accordingly, lossy compression is frequently used in 
video or commercial image processing. Two popular lossy 
image compression standards are the MPEG and JPEG 
compression methods. 
35 The wavelet transform has proven to be one of 

the most powerful tools in the field of data compression. 
Theoretically, the wavelet transformation is lossless, 
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but since all computers have only finite precision even 
when using floating point calculations, most of the 
transformations are lossy in practice* On the other 
hand, integer calculations are much faster than floating 
5 point for virtually all computers; and integer 

computations are much easier to implement in hardware, 
which is more important in some applications. While 
integers require less memory than real numbers, the 
direct use of integers in conventional wavelet transforms 
10 and their inverses typically causes an unacceptable loss 
of accuracy. Accordingly, there is a need for a wavelet- 
based compression technique that permits lossless or 
near-lossless data compression, yet retains the speed and 
memory advantages of integer arithmetic. 

15 

Summary of the Invention 

It is an advantage of the present invention to 
provide a system and method of wavelet-based data 
compression that permits integer computations in a 

20 computer without significant loss of accuracy. This is 
accomplished by using an integer reversible wavelet 
transform that possesses a property of precision 
preservation (PPP) . The integer reversible transform 
greatly reduces the computer resources needed to compress 

25 and decompress images, as well as the time required to 
perform the same. 

It is an advantage of the present invention to 
provide a system and method of wavelet-based image 
compression that is suitable for both still and video 

30 images. 

It is also an advantage of the present invention 
to provide a system and method of image compression that 
is capable of selectively performing lossless and lossy 
compression of either color or gray-scale images. 
35 According to one aspect of the invention, a 

wavelet-based image compression method can be implemented 
using a software program. Compression is accomplished by 
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performing a wavelet transform on an input digital image. 
The resulting wavelet components are compared to a 
threshold -value; coefficients falling below the threshold 
are discarded. The remaining coefficients are quantized. 
5 The quantized coefficients are then compressed using an 
entropy encoding technique, such as arithmetic, run 
length, or Huffman encoding, or a combination of Huffman 
and run length encoding. The wavelet transform can be an 
integer reversible wavelet transform derived using a 
10 lifting scheme or correction method, while the 

quantization scheme can be sub-band oriented. To further 
enhance the speed of the compression scheme, input color 
image pixels can be reduced using a color table. In 
addition, color pixels can be transformed between color 
15 spaces prior to wavelet transformation. 

According to another aspect of the invention, a 
corresponding method of decompression is provided. 

According to another aspect of the present 
invention, a compression method is provided that allows 
20 user selected portions of an image to compressed to 

different image qualities, whereby permitting non-uniform 
image compression. 

According to another aspect of the present 
invention, a compression method is provided that permits 
25 compression quality to be based on image specific 
parameters . 

According to another aspect of the present 
invention, a method of compressing images using a "split 
and merge" technique is provided. 
30 According to further aspect of the present 

invention, an image compression system includes a 
compressor configured to generate a compressed image 
based on an integer wavelet transform derived using 
either a lifting scheme or correction method. The 
35 compressor can be implemented using one or more 

electronic components, such as application specific 
integrated circuits (ASICs), microprocessors, discrete 



logic components, or any combination of the 
aforementioned. 

According to another aspect of the present 
invention, a corresponding image decompression system is 
provided. 

Brief Description of the Drawings 

The invention is pointed out with particularity 
in the appended claims . However, other features of the 
invention will become more apparent, and the invention 
will be best understood by referring to the following 
detailed description in conjunction with the accompanying 
drawings, in which: 

FIG. 1 illustrates a flow diagram for a method 
of compressing an image that is in accordance with an 
embodiment of the present invention; 

FIGS. 2-4 depict wavelet coefficients for 
various levels of decomposition; 

FIG. 5 illustrates a flow diagram of a method of 
decompressing an image that has been compressed using the 
method of FIG. 1; 

FIG. 6 is a block diagram of a system that can 
incorporate a software program implementing any of the 
methods shown in FIGS. 1, 5, and 8-13 in accordance with 
a second embodiment of the present invention; 

FIG. 7 is a block diagram of a system for 
compressing and decompressing an image in accordance with 
another embodiment of the present invention; 

FIG. 8 illustrates a flow diagram of a method 
compressing an image that is in accordance with a further 
embodiment of the present invention; 

FIG. 9 illustrates a flow diagram of a method 
for decompressing an image that has been compressed 
according to the method of FIG. 8; 

FIG. 10 illustrates a flow diagram of a method 
of compressing an image in accordance with a further 
embodiment of the present invention; 



FIG. 11 illustrates a flow diagram of a method 
of decompressing an image that has been compressed 
according to the method of FIG. 10; 

FIG, 12 illustrates a flow diagram of a method 
of compressing an image that is in accordance with a 
further embodiment of the present invention; and 

FIG. 13 illustrates a flow diagram of a method 
for decompressing an image that has been compressed 
according to the method of FIG. 12. 

Detailed Description of the Preferred Embodiments 

Referring now to the drawings, and in particular 
to FIG. 1, there is shown a flow diagram of a method for 
compressing an image that conforms to a first embodiment 
of the invention. In step 20, a digital image is 
received from an image source. The digital image 
consists of a matrix of values representing an array of 
pixels. Specifically, the array of pixels represents a 
still image or a frame from a video image. In step 22, 
the image is optionally displayed on an appropriate 
viewing device, such as a computer or video display unit 
having a flat panel or cathode ray tube (CRT) . Next, in 
step 24, color and wavelet transformations of the image 
take place. The image transformations involved in this 
step include color transform for color images only, and 
wavelet transform for both gray level images and color 
images. In step 26, the values representing the 
transformed images are quantized and compared to 
thresholds. Values falling outside the threshold are 
discarded. In step 28, the remaining quantized values 
are encoded to remove redundant information, creating a 
compressed image file. Next, in step 30 the compressed 
image file is generated as output. 

Referring to the color transformation of step 
24, digital color images are typically based on an RGB 
color model, such as is commonly used with TIFF or BMP 
images. In order to get a higher compression ratio, the 
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RGB pixels are transformed to other color models, such as 
YIQ or YUV models* The method can convert RGB inputs 
into YIQ or YUV color spaces according to the following 
relationships . 



5 RGB to YIQ: 



[Y]=[ 0.299 
| I|=| -0.596 
[_Q>[_ 0-212 



0.587 
-0.275 
-0.523 



0.114"! [R] 
0.321| |G| 

0.311J L B J 



RBG to YUV: 

10 r Y ~lH~ 0.299 

|U|=| 0.148 

l_V]=L 0.615 



0.587 0.114"! [R] 
-0.289 0.439] |G| 
-0.515 -0.1J |_Bj 



In the YIQ color space, there is one 
luminescence (Y) and two color planes (I, Q) . The Y 

15 component is critical, while the I-Q components are less 
sensitive to error introduced by data compression. 

The wavelet transform (also referred to as 
wavelet decomposition) operates on the converted color 
space signals. The purpose of the wavelet transform is 

20 to represent the original image by a different basis to 
achieve the objective of decorrelation. There are many 
different wavelet transforms that can be used in this 
step. For instance, the reversible integer wavelet 
transform described herein below is a preferred wavelet 

25 transform. However, to develop a better understanding of 
the preferred transform, the following alternative 
wavelet transform is first described. 

Let C° = [Cj k ] (j - 0, M-l; k = 0, 

N-l) represent the original, uncompressed image, where M 
30 and N are integers which have the common factor 2 L (L is a 
positive integer) . A one-level wavelet decomposition, 
where L = 1, results in the four coefficient quadrants as 



-8- 



10 



15 



shown in Figure 2. Each quadrant represents a set of 
wavelet coefficients. 

Quadrant C 1 represents the blurred image of the 
original image C°, where C 1 = [cj*] <j=o, ^-i; k=o,... f ^-i) . 

HD 1 represents the horizontal high frequency part of C°, 
while VD 1 represents the vertical high frequency part of 
C°, and DD 1 represents the diagonal high frequency part of 
C°. The decomposition can be iteratively repeated L times 
to obtain different levels of decomposition. For 
example, for L = 2, C° is set to equal C 1 . The iterative 
formula for computing a decomposition is given as 
follows : 

(1) Let C° = rC°, r>0 is a factor which can be changed for 
different needs. 

(2) Transform for image columns: 

For k=0 / ...,N-l / calculate 



U 0k o 1 



(3.1.1) 



For k=0,...,N-l, calculate 



u 0*~ u I,lfc 2 ' 

°jk C 2J+I, k 2 ' J '"' 2' 



~2~- f &-t-N-i,k — 2~ ' 



(3.1.2) 



(3) Transform for rows: 

For j = 0, . * .M/2-1, computing 
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na j, o ~ » 

2 (3.1.3) 



and 



Cjk- C j,2k+1 2 ' '"' ~2 



(3.1.4) 



For j = 0, 



, M/2 - 1, computing 



ddj, 0 = 



(3.1.5) 



and 



va jo- a j,i 2 ' 

< _ai _ rfe^ f jc-cfc^,^! M_ 2 



(4) C^tc^J f HD 1 =[hdl k ] ^^[vdUand DD=[ddj rk ] , j=0,..,,|-l 



Remark: If it is necessary, we also can use matrix 
5 multiply Wavelet Coefficient Image of 1 levels^C 0 !^ . 
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Here, W 1 is the transform matrix for 1 level wavelet 
decomposition, 

FIG. 3 depicts a three-level wavelet 
decomposition, where L = 3. 
5 In step 2 6, the first loss in accuracy occurs. 

Both thresholding and quantization reduce accuracy with 
which the wavelet coefficients are represented. In step 
26, the wavelet coefficients are matched against 
threshold values, and if the values are less than the 
10 established threshold values specified, then the 
resultant value is set to zero. 

An important feature of the invention is that 
the wavelet coefficients are then quantized to a number 
of levels depending upon which quadrant is being 
15 processed, and the desired compression or quality factor. 
This can be very important in image compression, as it 
tends to make many coefficients zeros, especially those 
for high spatial frequencies, which reduces the size of a 
compressed image. 
20 A multilevel uniform thresholding method can be 

used as described below. 

Let T = (t 17 t L , t L+1 )be the chosen 

thresholds, where t t is the threshold for 1 the (1=1, 
L) level and t L+1 is a threshold for blurred image C L . 
25 Thresholding sets every entry in the blocks C L , HD 1 , VD 1 

and DD 1 (1 = 1, . . . L) to be zero if its absolute value is 
not greater than the corresponding threshold. 

For color images, three threshold vectors which 
correspond three different color planes, such as y, I and 
30 Q, are used. 

The step of quantization essentially scales the 
wavelet coefficients and truncates them to a 
predetermined set of integer values. The quantization 
table shown in Table 1 can be used. 
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q 2 HD 










q 2 vD 




q L vD 




q x DD 


q 2 DD 




q^DD 



TABLE 1 

5 In Table 1, the entries q 1 ^ are quantization 

factors for blocks HD 1 (1 = 1, . . . L) , q L TO and qV for 
blocks VD 1 and DD 1 (1=1, L) respectively, and the 

factor q c t+1 is for the most blurred image C L . The factors 
can be integers between 0 and 255. The quantization 
10 scheme for the block HD 1 (1 = 1, L) is 

Bq.t-zoun* ^i^,i=0 *-i,*-0 ^-1. , < 3 ' 21 



Here, hdl k { j=0 , -1; , k=0 , ~ -1) axe quantized 
Jt 2 2 

wavelet coefficients of block HD 1 {1=1,..., L) 

max^,= max ( \hd/ fk \) , 
0lj*(M/2 1 -l) 
Q<kl{N/2 1 -l) 

and the function round gives the nearest integer of x. 
Equation (3*2.1) is used for quantization of the other 
blocks (quadrants) . 

For color images , there are three separate 

15 quantization tables for the different color bands. 

In step 28, entropy compression is applied to 
the resultant coefficients using either Arithmetic, Run 
Length, or Huffman, or Huffman and Run Length combined. 
The compression algorithm- can be selected at run-time by 

20 the user, based on the desired compression ratio and the 
amount of time required to get the selected level of 
compression. The encoding step includes the entropy 
compression as well as coefficient rearranging. 
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An alternative process to that shown in FIG* 1 
includes an optional down sampling of the IQ color 
planes. This down sampling may be done once or twice to 
produce two image planes either one-fourth or one- 

5 sixteenth the size of the original plane. If the down 
sampling is done, it will be accomplished prior to the 
wavelet transform of step 24. The down sampling reduces 
the compression time and size of the image file. 

FIG. 5 shows a corresponding method for 

10 decompressing an image compressed using the method of 

FIG. 1. In step 40, the compressed image file is input. 
In step 42, the image is decoded. Next, in step 44 the 
values are de-quantized. Next, in step 46 inverse color 
and wavelet transformations are performed on the de- 

15 quantized data. In step 48, optional image post- 
processing takes place to refine the decompressed image. 
In step 50, the decompressed image is displayed. 

The decoding of step 42 is the inverse operation 
of the encoding of step 28. Similarly, it can be divided 

20 into two parts: Entropy decoding (Huffman or 
arithmetic), and coefficient rearranging. 

The decoding step produces quantized wavelet 
coefficients in 3*L+1 blocks. Dequantizing (step 44) 
uses the same quantization table as quantizing (Table 1), 

25 and the scheme as follows: for 1=1, L 

hd i ™*k fj=Q/ JL ■! - j^q , ... , JL -l , (4.2.1) 

— J' k Qhd 2 1 2 1 

Equation (4.2.1) produces the approximate coefficients 
for the blocks HD 1 (1 = I, L), which are shown in 

FIG. 3. The dequantizing scheme for other blocks is 
similar to 4.1.2). 
30 In step 46, the inverse wavelet transform, also 

referred to as wavelet reconstruction, is performed prior 
to the inverse color transformation. FIG. 4 depicts a 
one-level wavelet reconstruction. 
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The wavelet reconstruction can be iteratively 
performed for various levels of decomposition, according 
to the following equations. 
(1) Inverse transform for rows: 

For j=0, , ~ ~l r calculate 

4u 



and 



and 



a j,i loa i # o + 2 

3 l -nrf 1 + dd lk-ddj tk+1 N_ 2 
d j,2k+i-vajk+ 2 ' 2 



(4.3.1) 



OEj^Jc " 5 * aa j,kr K X '"' / ^ 



(4.3.2) 



For j = 0, 



, M/2 - 1, calculate 



c j,i -c jo + 2 

~i _i ^ hd$ tk -hdl k+1 n__ 9 (4.3.3) 

Cj,2jt+i-Cj* + 2 ' ' "2 



C j , o = C I i - 2 72 d} , o , (4.3.4 
5j,2k=^ (Cj t2 k-i + Cj t 2k+i) -2hdj kf Jc=l..., — -1 . 



(2) Inverse transform for column: 
10 For k=0, . .., N - 1, calculate 

and 
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( 31 .31 

— 0 _«i ^ a Ok +a i,k 
C\,k-Cok + 2 ' 



2 

-2 



(4.3.5) 



^0 _„0 o 31 



(4.3.6) 



C$.*r8l* J=0,...,^-l; ic=0,...,W-l.C°=[c J ? Jc ]f^ r 



10 



Following the inverse wavelet transformation, an 
inverse color transform is performed. Equations (5) -(6) 
give the inverse transforms for the YIQ and YUV color 
spaces . 

For YIQ to RGB: 





r i.ooo o 


.956 


0.621"! 


m 




jG| = 


= | 1.000 -0 


.272 


-0.647| 


III 


(5) 


LbJ 


j_ 1.000 -1 


.106 


1.703J 


LQJ 




For 


YUV to RGB: 










r*i 


T 1.000 0 


.000 


1.1401 


m 






=| 1.000 -0 


.395 


-0.581 | 


|u| 


(6) 


LbJ 


L 1.000 2 


.032 


O.OOOJ 


Lvj 





In step 48, a user can optionally apply image 
filtering to improve the image quality. Filters are 

15 known in the art for sharpening, smoothing and 

brightening images. Users can choose any number of 
processing filters at compression time. Information 
defining the selected filters can be stored in the coded 
image file, in a form such as a one byte flag in a file 

20 header. In addition to optionally applying the filters, 
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the method can also be implemented to automatically 
detect and apply the selected filters following 
decompression. 

To sharpen an image, a filter is used that 
5 weights the eight pixels adjacent to the current pixel, 
as well as the current pixel, by one or more 
predetermined values. The weighted values of the nine 
pixels are then summed to derive a new value for the 
current pixel. For example, the surrounding eight pixel 
10 values can be weighted by the value -35/800, while the 

current pixel is weighted by 1.35. The sharpening filter 
is applied to every pixel in the image. 

To smooth images, for every pixel, the average 
of the pixel and the eight adjacent pixels is calculated. 
15 Then the pixel value and the average is compared. The 
smaller of the two replaces the original pixel and is 
output as the smoothed pixel value. 

To brighten images, the weighted sum of each 
pixel and the correspond eight adjacent pixels is 
20 calculated. For example, each of the adjacent pixels can 
be multiplied by the value 1/90 and the summed with the 
current pixel to obtain a brighten current pixel. 

Another filter that can be used is one that adds 
a random value between [-12, 12] to each of the pixels in 
25 the image . 

In FIG. 6 there is displayed a preferred 
hardware platform that can execute software for 
implementing an embodiment of the present invention. The 
computer system of FIG. 3 includes a CPU 62, a main 
30 memory 64, an I/O subsystem 66, and a display 68, all 
coupled to a CPU bus 70. The I/O subsystem 66 
communicates with peripheral devices that include an 
image source 72, an image storage device 74, and a mass 
storage memory 76. Although shown as three separate 
35 devices, peripherals 72-7 6 can be implemented using a 

single memory device, such as a hard disk drive commonly 
found in computers. 
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The image source 72 may be a digital still image 
or video source, such as a CD-ROM drive, scanner, or 
network connection. In addition, the image source 85 can 
include analog video sources, such as a video camera, 
5 VCR, television broadcast or cable receiver. The analog 
video signals would be converted to a digital form by the 
image source 85 using conventional conversion techniques. 
Alternatively, an image source 72 can include a video 
camera and communications systems for transmitting real- 
10 time video to the I/O subsystem 66. 

The image storage 74 can be a computer disk, 
such as a that used by a hard drive, or a portable memory 
medium, such as a floppy or ZIP disk, or a read/write 
optical CD. 

15 In operation, a computer program, which 

implements aspects of the invention, is retrieved from 
the mass storage memory 7 6 into the main memory 64 for 
execution by the CPU 62. Upon execution of the 
compression aspect of the invention, the compressed image 
20 file can be stored in the image storage 74; while upon 
execution of the decompression aspect of the invention, 
the decompressed image can be viewed on the display 68. 
Operating under the control of the computer program, the 
CPU 62 can process images according to the methods set 
25 forth herein, as shown in FIGS. 1-2 and 6-10. 

FIG. 7 illustrates an alternative hardware 
platform implementing a system in accordance with a 
further embodiment of the present invention. System 80 
can be implemented using a variety of different hardware 
30 components, such as ASIC (Application Specific Integrated 
Circuits) , or a combination of discrete digital 
components, such as microprocessors, standard logic 
components, and other programmable logic devices. The 
system 80 includes a compression system 81 and a 
35 decompression system 82. The compression system 81 can 
be configured to perform any one or combination of the 
compression methods set forth in FIGS. 1, 8, 10, and 12; 
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while the decompression system can be configured to 
perform any one or combination of the decompression 
methods set forth in FIGS. 5, 9, 11, and 13. 

An image source 85 provides digital pixel values 
5 to a color converter 84. The image source 85 can provide 
the same functionality as described earlier for the image 
source 72 of FIG. 6. 

The color converter 84 performs a color space 
transformation on the input pixels , such as any of those 
10 described herein for FIG. 1. The converter functionality 
can be provided by conventional integrated circuits that 
are readily available from various manufacturers. 
Compressor 8 6 compresses the transformed pixels, removing 
redundant data. The compressed image file generated by 
15 the compressor 86 can be transferred directly to the 
decompression system 82 over a transmission medium 91. 
The transmission medium 91 can be a radio-link, computer 
network, cable television network, or satellite link. 
Alternatively, the compressor 86 can transmit its output 
20 to a portable storage medium 92, such as an optical, 

floppy, or ZIP disk; or to a mass storage device 94 such 
as a computer hard disk or archival system. 

The decompressor 88 expands the compressed image 
file by applying an inverse wavelet transformation, as 
25 well as de-quantization and de-encoding functions. The 
decompressed data is then passed to an inverse color 
converter 90 that applies an inverse color space 
transformation to generate pixel values in a color space 
and format appropriate for the image display 89. 
30 Standard electronic components are readily available for 
performing the function of the inverse color converter 
90. 

FIG. 8 illustrates a flow diagram of a method of 
compressing an image in accordance with an alternative 
35 embodiment of the present invention. In step 100, a 
digital image is input. In step 102, a color space 
transformation is performed on the input image pixels. 
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In step 104 , the pixels are subjected to a wavelet 
transformation. In step 106, sub-band quantization is 
performed on the wavelet coefficients. Next, in step 108 
the quantized sub-bands are respectively entropy encoded. 
5 In step 110, the coded image file is output. 

Sub-band oriented quantization and entropy 
coding are well suited for wavelet-based image 
compression. The main idea is to take the advantage of 
different quantizations at different sub-bands (wavelet 
10 quadrant) and encode each band accordingly. Quadrants 

having a high variance in wavelet values can be allocated 
a finer mesh size for quantization, while those quadrants 
with smaller variances will be assigned fewer levels of 
quantization. That is, the number of bits one wishes to 
15 allocate to the output could be varied by quadrant. 

Those quadrants with large variances will utilize more 
bits, while those with low variants will utilize fewer 
bits. In this way, the number of bits resulting from 
quantization will remain the same, but their allocation 
2 0 will differ depending upon the nature of the image. This 
technique greatly improves image quality while 
maintaining a high compression ratio. 

FIG. 9 illustrates a flow diagram of a method of 
decompressing an image compressed according to the 
25 methods shown in FIG. 8. Step 120, the compressed file 
is input. In step 122, the input image -is entropy 
decoded. In step 124, de-quantization is performed on 
the decoded image file. Next, in step 126, an inverse 
wavelet transform is performed on the image. , In step 
30 128, an inverse color transformation is performed. In 
step 130, post-processing altering is optionally 
performed. In step 132, the decompressed image file is 
then displayed. 

FIG. 10 illustrates a flow diagram of a method 
35 of compressing an image in accordance with another 
embodiment of the present invention. This method 
performs color-bit depth compression, which essentially 
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reduces the number of colors in the image to achieve 
compression. In step 140, the image is input with its 
original color. For example, each color pixel could be 
represented by a standard 24-bit value. Next, in step 
5 142, a color table is created corresponding to the image. 
The color table is a set of quantized color values. The 
quantized color values represent a smaller number of 
colors with correspondingly fewer bits. Each of the 
input pixels is mapped to the color table. In step 144, 
10 an index is calculated for each pixel in the image by 

dithering the pixel values. Dithering is accomplished by 
weighting pixels adjacent to the current pixel in a frame 
and then arithmetically combining the weighted values 
with the current pixel value to produce the index, which 
15 then represents the current pixel. The dithering process 
is repeated for each pixel in a frame. In step 14 6, the 
indexes are wavelet transformed. In step 148, the 
wavelet coefficients are entropy coded. In step 150, the 
coded image file is output. 
20 FIG. 11 illustrates a flow diagram of a method 

of decompressing an image that has been compressed 
according to the method shown in FIG. 10. In step 160, a 
compressed image file is received. Next, in step 162, 
the image file is entropy decoded. In step 164, an 
25 inverse wavelet transform is applied to the decoded data. 
Next, in step 166, post-processing filtering of the image 
is optionally applied. Next, in step 168, the 
decompressed image is displayed. 

FIG. 12 illustrates another method of 
30 compressing an image in accordance with another 

embodiment of the present invention. In this method, a 
user can selective vary compression parameters (step 173) 
to obtain a lossless or near-lossless compressed image at 
a desired compression ratio. In step 170, the image is 
35 input. In step 172, an integer color transform is 

performed on the input image. In step 173, compression 
parameters are selected by the user using a software 



interface. These parameters can include those described 
herein below in the subsection title "Peak Signal to 
Noise Ratio (PSNR) Controlled Compression". In step 174, 
an integer wavelet transform is performed on the color 
transformed pixels. In step 17 6, the wavelet 
coefficients are entropy coded. Next, in step 178, the 
compressed image file is then output from the system. 

The integer color transformation of step 172 is 
an integer reversible transform which can be used in 
color image compression to reduce processing time and 
image size. Step 172 transforms RGB color components to 
a set of color components Y-Nb-Nr, which are known. 

The RGB to Y-Nb-Nr transform is given by the 
equations : 

Y = G + Int (R/2 + B/2) , 
Nb = B - Int (Y/2) , 
Nr - R - Int (Y/2) . 

The integer wavelet transform of step 174 is 
described below in detail. 

FIG. 13 illustrates a method of decompressing an 
image file that has been compressed according to the 
method shown in FIG. 12. In step 180, a compressed image 
file is input. In step 182, the image is entropy 
decoded. Next, in step 184, an inverse integer wavelet 
transform is performed on the decoded data. In step 18 6, 
an inverse integer color transform is performed. Next, 
in step 188 optional post-processing filtering is 
performed on the image. Next, in step 190, the 
decompressed image is displayed. 

The Y-Nb-Nr to RGB transform of step 18 6 is 
given by the equations: 

R = Nr + Int (Y/2) , 
B - Nb + Int (Y/2) , 
G - Y - Int (R/2 + B/2) 
The inverse integer wavelet transform of step 
184 is described in detail below. 
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Reversible Integer Wavelet Transform 
This method allows a series of transformations 
which are very close to the corresponding biorthogonal 
wavelet transforms or some non-orthogonal wavelet 
5 transforms, but can be calculated with only integer 
addition and bit-shift operations. In addition, the 
integer wavelet transforms created disclosed herein 
possess a property of precision preservation (PPP) . This 
property is very useful for conserving memory in both 
10 compression and decompression, and speed up the whole 

procedure in some applications. Two general methods from 
which one can get the integer wavelet transform desired 
are disclosed. 

Basic Integer Wavelet Transformations 
15 Two examples are provided as the starting point 

for the unique method. For the sake of convenience, 
length, and simplicity, presented is only the algorithm 
for a one level decomposition and reconstruction and only 
for a one dimensional signal. The extension to two 
2 0 dimensions is immediate as the rows and columns can be 

treated into a sequence of one dimensional signals. For 

the following examples, assume that {c^}^ is the 

original signal where the superscript indicates level and 
the subscript indicates a particular point in the signal. 

25 Also, {cij^and {dn}^ are its decomposition parts at the 
first level. Here 
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2 

M 1 =N-N 1 



— , if N is an even number, 
2 

^ii, if N is an odd number; 



{cn}* 1 ^ and {dn}2J 0 are its low frequency (1) 

part and high frequency (h) part, respectively. For 
multi-levels, we just create {c*}^" 1 as {c°}^ 0 and repeat 



the procedure again. 
5 Example 1 : A (2, 2) -wavelet transform by integer 

calculation. 

This transformation is similar to a variation of 
the Haar wavelet transform which uses low and 
high pass analysis (decomposition) filters given 
10 as: 



;i) Compute 



n 


0 


1 


9n 


1/2 
1/2 


1/2 
-1/2 



djt =4-^1 , k=0 , ...,2^-1 , 



(2.1) 



(2) Compute 
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d 1 

c£=Int{-±) +c 2 \ + i/ k=0,...,N^-2, 

Jj3t( J ^" 1 ) +C 2 °fc + i/ -i-f # ^ an even number, 
2 

c£. 1# if N is an odd number. 



Here, Int(x) is an arbitrary rounding function 
which may have different interpretations. For example, 
Int (x) can be the integer which is nearest to x, or 
Int(x) may be any integer which satisfies x-KInt (x) £ x, 
5 etc. It is easy to see that all entries in both 

{^"dW are integers. 

From (2.1) -(2.2), we can easily get the 
following integer reconstruction algorithm: 
(b) Reconstruction 
10 (l)If N is an even number, compute: 



d 1 

c 2 Vi=ci-Jnfc(-^-), Jc-O,...,!^-!; (23 > 



or, if N is an odd number, we have 

d 1 

c£ k+1 =Ck-Int(^) . ic=0,...,iV 1 -2/ 



di. 

: --LUC V 

-0 _ I 



2 1 ' (2.4) 



(2) Compute 

C2k=dk + c$k+i k= 0 , ... , M 1 - 1 . 



(2.5) 



Remark . Since (2.1) -(2.6) are not linear because of the 
rounding operation Int (x) , this means the transformation 
order becomes significant . For instance, if the 
decomposition was applied first to the columns and then 
5 to the rows, the inverse transformation must be applied 
first to the rows and then to the columns . 

Example 2 : Lazy wavelet transform. 

The lazy wavelet transform is used to illustrate an 
important concept. The corresponding inverse transform 
10 is nothing else but sub-sampling the even and odd indexed 
samples. Decomposition and reconstruction can use the 
same formula as follows: 

c£=c£ kf k=0,...,N x -lt 

Examples 1 and 2 are not good transforms for 
image compression, but they are simple. Much better 

15 transforms can be achieved from these two. As suggested 
above, they are considered only as a starting point for 
the integer, reversible, wavelet transform algorithm of 
the disclosed invention. 

It is noted that there is another interesting 

20 property in the above two transforms which may not be 
easily seen. If the values of the signal pixels are 
represented by a finite number of bits, say one bit or 
one byte, the same number of bits can be used to 
represent the result of the forward transform within the 

25 computer itself because of the complementary code 

property. While, from the reconstruction algorithm, the 
computer will get back the exact original signal through 
the same complementary code property. This property is 
called a Property of Precision Preservation (PPP) for 

30 these wavelets. 

It is known that the general values for the high 
frequency wavelet coefficients are small, and all higher 
levels of the decomposition also provide generally small 
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values in the high frequency band. This allows the 
preservation of precision during the computational stage 
of the wavelet coefficients. Now, the complementary code 
property, the other aspect of the PPP property is a well 
known characteristic of integer arithmetic as done by the 
computer. Consider the computation of the difference of 
two integers given as c = b - a and the inverse 
computation of a = Jb - c. The nature of the computation 
within the computer can be specified as follows: 



b-a if -2^- 1 ^i3-a<2^- 1 -l 
-2^+jb-a if b-a^e- 1 
if jb»a< -2^ 



10 and the inverse is 



a = 



b-c m if -2^- 1 ^±)-a<2^- 1 -l 
-2*+jb-c m ifb-c^' 1 



2<2+b-c„ 



if b-c m < -2<z- 



where the m subscript indicates the internal 
representation, and the range of the integers a, b, c 

is [-2^" 1 ,2^" 1 -1] . The internal representation of c m when 

it is outside the range, its appearance is as a two's 
15 complement number, so the representation may not be the 
same as the external representation of c. However, the 
same complementary code for the a m will cause the internal 
representation to be identical to the external 
representation of a. For example, if we let b = 2 
20 (00000010) and a = -127 (10000001) then c m has the 

internal binary value of (10000001) when q=4 . With a 
value of -127 for c m the inverse value for a m will just be 
a. 

In fact, for Example 2, this property is 
25 obviously true. While for Example 1, if the range of the 
pixel values is within a finite number of bits, say q, we 
can only use q bits as the working unit, which means the 
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value of transform coefficients will also be within the 
interval with length 2 q , say [-2*" 1 , 2 q " 1 - 1] . Due to the 
nature of computation on a machine, most machines will 
implement (2.1) -(2.2) automatically as follows (the 
5 complementary code property) : 



o _ o 

^2k C 2k+1 s 



if -2« J ic&-c 2 Vi<2« rl / 

C2k~ c 2k*X~2 q , if C2k~C%k+x£2 9 ~ 1 , 

2^(4-4!) , if cl k -cl k ^<-2*-\ 



(2.6) 



In t{^i)+c° k+1 -2e, if M(|) + c^ ( (2 ' 7) 

d 1 d 1 
Int(-±) +c& + i+2*, if Int(-±) + c 2 Vi< -2*-\ 



While the reconstruction algorithm (2.3) and 
(2.5) will be implemented by the computer itself as 



d 1 d 1 

c 2 °ic +1 = < 2*+[ci-Int{^ r ) ], if ct-lnt{^£)<-2<r*, 
(cj?-JJ2t(-^)]-2^ if c£-Int{^)>-2*-\ 



(2.8) 



C 2k \ 



if -2*- % <d£ + c2 k+1 <2*-\ 



* + c 2 Vi + 2*, if , 



(2.9) 



It is obvious that (2.8)- (2,9) are just the reverse of 
(2.6)-(2.7). It is also easy to see that if we properly 
10 take advantage of the bound in the coefficient size 

mentioned above, the algorithm can be implemented using a 
minimal amount of storage. 



The following are examples which give motivation 
for our new approach. 

Example 3 : A (2.6) wavelet transform by integer 
calculation (2) . 

This transformation is similar to using the 
following analysis filters: 



n 


-2 


-1 


0 


1 


2 


3 




0 


0 


1/2 


1/2 


0 


0 








9 n 


-1/16 


-1/16 


1/2 


-1/2 


1/16 


1/16 



(a) Decomposition 

Decomposition starts with Example 1 at step (1) 
and (2), and then upgrades the high frequency component 
at step (3) : 
(1) Compute 



(2) Compute 



d 1 ' 0 



Int( — - — ) , +0$-!, if N is an even number, 
2 

Cx-n if N is an odd number; 



(3) Compute 



) -di'° ,lc=l,...,M L -2, 



and then, if N is even, calculate 
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d Ml -i^mt( ) -a^-i/ 

else, calculate 

d Ml -i=Int{ ) -q^-i - 

(b) Reconstruction 

The reconstruction algorithm is identical to the 
decomposition algorithm, except it is now running 
5 "backwards" . 

(1) Compute 

and then, if N is even, calculate 

i _ i 

<-°i-Int:( 1 4 1 ) -di- 1 !/ 

else calculate 

i _ i 

d M ;-i~mt( ^ ) -d^-i/ 

(2) If N is an even number, compute 

10 or, if N is an odd number, we have 

d 1/0 

c£ k+1 =c£-lnt(— 1») , Jc-O,...,!*^; 
o _ 1 



(3) Compute 



c 2 W*' 0+ c 2 0 jc*if *=0,...,«i-i. 

We see in step (2) -(3) above, that they are just 
the same as shown for the reconstruction of the (2.2)- 
wavelet transform (Example 1) . 

Example 4 : A (1, 3) -wavelet transform by integer 
calculation. 

The following nonlinear transform is a variation of the 
transform which uses biorthogonal analysis filters: 



n 


-1 


0 


1 


&n 


1 
1/4 


0 

-1/2 


0 
1/4 


9 n 









(a) Decomposition 

This decomposition starts with the Lazy wavelet 
at step (1) and upgrades the high frequency component at 
step (2) : 

(1) Set 

ci-c&f Jc= 0 -1; 
dk=c£ k+1 , k=0 , ... / A^-l . 

(2) If N is an even number, calculate 
dt =lnt ( Cfcl -" C ^ ) -dl' 0 ,k=Q , ... , M x -2 , 

i ^ 

_7l _ 1 _ ^1,0 



Otherwise, if N is an odd number, calculate 
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(b) Reconstruction 

(1) Set 

c£ k =Ck, k=Q,...,N 1 -l; 

(2) If N is an even number, calculate 
c^lnt( C2 °* + 2 C °*+ 2 ) *=0 f ...,2^-2 , 

_0 _ „0 _ _il 

Otherwise, if N is an odd number, calculate 



5 Example 5 : (5, 3) -wavelet transform by integer 

calculation. 

This transformation is also similar in function 
to using the biorthogonal analysis filters. It is given 
by 



10 


n 


-2 


-1 


0 


1 


2 




K 


-1/8 
1/4 


1/4 
-1/2 


3/4 
1/4 


1/4 
0 


-1/8 
0 

















(a) Decomposition 

This decomposition starts with Example 3 at step 
(1) and upgrade low frequency components at step (2) : 
15 (1) Set 
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Ck' Q =cL, k=Q,...,N 1 -l; 



If N is an even number, calculate 



.0 , „o 



drl _ _ 0 1 



Otherwise, if N is an odd number, calculate 



(2) If N is an even number, compute 



d 1 

1 1,0 rr- ^ t < ^N 1 -2 +< ^N 1 -l - 



Otherwise, if N is an odd number, calculate 



C 0 1 -C 0 1 '°-XJ2t(-$.) , 



cW 0 -^, 2^ -2, 



5 (b) Reconstruction 

(1) Compute 
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cl K =cl+In t ( dk ~^ dk ) , k=l , ... , -2 , 
Then, if N is even, calculate 

c N - 2 =c Nl -i + Int{ - ) . 

else calculate 
(2) Compute 

o + o 

Then, if N is even, calculate 

C N-1 c N-2 a Af t -i " 

5 The PPP property for Examples 1-2 mentioned at 

the end of the previous section is also applicable for 
these three examples. It is obvious these three 
transformations are not really linear, but they are 
similar to the one using the corresponding filters given 

10 above. Especially, the filters in Example 3 and Example 
5 belong to, with minor modification, the group of the 
best biorthogonal filters for image compression. 

Also, from the above three examples, we can note 
that if we begin with integer (linear or nonlinear) 

15 wavelet transformations and then use some proper 
upgrading formulas, we can get other, much better 
integer, wavelet transformations for image compression. 

Lifting Scheme and Integer Biorthogonal Filtering 
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The Lifting scheme, discussed by W. Sweldens in 
"The Lifting Scheme: A Custom-Designed Construction of 
Biorthogonal Wavelet" , Applied and Computational Harmonic 
Analysis, Vol. 3, No, 2, April 1996, is a recently 
5 developed approach for constructing biorthogonal wavelets 
with compact support. It can be used, with minor 
modifications, to create integer biorthogonal wavelet 
transformations. The following is an adaptation of the 
lifting scheme. 

10 Definition 1 . The set of filters {h, h, g, g}, a set of 
biorthogonal filters if the following formula is 
satisfied: 



Vo)€R:jS(q)M / (co) =1. 
|72(<o) h{<o+7z) 



where 

and _ 

k k 

and similarly for iH{co) , £(<■>) and sf(co) 



A(co) =J2h k e~ k <»and sr(co) ^ff k e' kn i 



The following lemma is the main result of the 
lifting scheme [1] reported as corollary 6 in that paper. 
15 Lemma 1 . Take an initial set of finite 

biorthogonal filters {h, h, g, g}, then a new set of 
finite biorthogonal filters {h, h, g, g} can be found as 

£(co) =5° (to) +^(co) s(2g>) 
Sf(<*) =g° (co)-i3(co)s(2co) . 

Similarly if we take {h, h, g, g} as an initial set of 
biorthogonal filters, a new set of biorthogonal filters 
20 {h, *h, g, g} can be found as can be found as 
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h(&) =h° (o) +flr(o>) s(2o>) 
g{<*) =§f° (<->) -£(<d) s(2co) . 

Here s (w) is a trigonometric polynomial and the 
corresponding filter s is finite, and so is Is (ca) . 
Actually, regarding the filters (4.1) is equivalent to 

1 

h k =h k + J^ 9k+21&l 

1 



or 



5 Next we use the lifting scheme with minor 

modifications to create an integer, nonlinear, quasi- 

biorthogonal, wavelet algorithm. Suppose is a 

[<£] [c£] 

original signal, and are again its low and 

high friequency decomposition parts, obtained by using the 
10 filters {h, h, g, g} . 

If we use filters {£, g} for decomposition 
(analysis) , the corresponding decomposition algorithm is 

n 

C°9 n . 2k . 



While the reconstruction algorithm will be 
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c°=2 



2k 



a, 



a. 



related to the synthesis filter {h,g}. Here, parameters 
a c and a d are positive constants with a c «a d =2. For 
example, in the situation of regular biorthogonal 
decomposition and reconstruction, a c =a d =f2; and for 
5 Example 1 through Example 5 above, a c =l and a d =2 . 

If the set of filters {h, g, g"} is from (h, 
"h 0 A g° r g} by (4.2b), then decomposition can be 
accomplished as follows: 



Calculate 



10 2. Calculate 



n 

<**-«e£ C n§n-2k- 



d 1 



C4-4) 



The relative reconstruction scheme will be: 



1 . Calculate 

c * -°*a£ d ~* (4.S) 

2 . Calculate 

Here, equations (4.3) and (4.6) are just the wavelet 
15 (inverse) transforms using biorthogonal filters {h, h, g, 
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g} . While (4.4) and (4.5) are forward and backward 
upgrading formulas . 

Similarly if the set of filters {h, h, g, g} is 
from the initial set of filters {h°, h, g, g} by using 
5 (4.2b), the relative decomposition is: 

1 . Calculate 

C k=<X c J2 °* h n-2k 
n 

i 

k a dZ^ C n9n-2k* 
n 

2 . Calculate 

The reconstruction scheme is : 
1 . Calculate 
10 1. Calculate 

«d i * _1 



Calculate 
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Corollary 4.1. , Suppose biorthoganal filter s{h, R, g, g] 

are from initial filters{h, fi° f g° , g] by the lifting scheme 
(4.1a) or (4.2a) . If the decomposition and reconstruction 

by filters {h, E° , g° , g} can be accomplished only by integer 
calculation, such as Example 2, we also can create a 
corresponding integer wavelet decomposition and recon- 
struction scheme which is very " close 11 to the original one 
by using filters {h,£, g, g,} . Here the word "close" means 
that the difference of the two decompostion schemes 
is just some rounding error, and this rounding error will 1 
corrected by the integer reconstruction scheme. 

In fact, if {ck'°} and {d£} are integer after (4.3) , 
we can calculate jc£} by 

ct=ct° + Int^Y; d *-i s i) 

instead of (4.4). Here Int(x), as described in Section 
2, is an arbitrary rounding up function which satisfies 
x-1 <> Int(x) ^ x+1. It is obvious that (4.7) is very 
close to (4.4), and the exact reconstruction scheme can 
5 easily be obtained from 

and (4.6). There will be a similar result, if the set of 
biorthogonal filters {h, h, g, g} is obtained from the 
initial set of filters {h, h, g, g} by using (4.2b). 

Except for the example shown in the Lazy wavelet 

10 (Example 2), most standard biorthogonal wavelet forms 

cannot be performed directly by integer, even for one of 
the simplest wavelets, the Harr wavelet. However, if the 
parameters a c , and cc d are properly chosen and the 
transform algorithms, such as Example 1 and Example 3, 

15 are slightly changed, a variation of the original 
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biorthogonal wavelet transforms with respect to the set 
of filters {h, h, g, g} is created. On the other hand, 
the parameters should be also chosen carefully to 
guarantee that only addition and shift operations are 
5 needed by the algorithm. 

If the set of filters {h, h, g, g} is obtained 
from a set of filters {h, h, g, g} by the lifting scheme, 
and the set {h, h, q, g} is also obtained from a filter 
set {h, h, g, g}, one can repeatedly use Corollary 1 to 
10 get a "close" integer wavelet transformation. 

The Correction Method for Creating 
Integer Wavelet Transforms 

Another approach for obtaining integer wavelets 

is using the so-called Correction method. The motivation 

15 of this method is from the S+P transform* The lifting 
scheme for generating biorthogonal wavelets can be 
considered as a special case of the correction method. 
From this can be derived complicated filters with fast 
decomposition and reconstruction algorithms. 

20 Assuming a simple integer wavelet transform, 

such as Examples 1 through 3, the decomposition and 
reconstruction scheme of which can be formulated as 
follows: 

Decomposition 



c}' 0 -df a ({c$) 
dt'°-df a ({cfi) 



(5.1) 



25 Reconstruction 

c° n =rf({c^} f {dt 0 }) 

Here, (5.1) and (5.2) can be the same as (4.3) and (4.6) 
or other algorithms . 

In general, after the above decomposition, one 
may not be satisfied with the result. There may still be 
30 some correlation among the high pass components because 
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of the aliasing from the low pass components , or the low 
pass components do not carry enough of the expected 
information from the original signal. Hence, one could 
make an improvement by putting some correction part on 
5 the high pass components or low pass components. There 
are many ways to accomplish this. However, for the sake 
of the integer calculation, it is preferable to use 
following correction method. To make a correction for 
the high pass part, the corresponding formula would be: 

d^d£> Q -Int(dc^, k )k^ t 0,1,2- (5.3) 
10 Here, dCj, 1 is a correction quantity for d k x 

d£ =£ 0;^;° + £ x^;] , ic=- ,0,1,2,-. (5.4) 
J=l J-l 

and ^ ^ Ij'.Sa and f 3?]j a , are given parameters which 
have been chosen for the user's purpose such as reducing 
the redundancy among high pass components or some other 
special requirement. To preserve the integer 
15 calculation, any entries in both 

^C-S© and ^ ^ilj"' should be rational numbers with 
denominators being powers of 2. 

From (5.1), (5.3) and (5.4), it is easy to see 
the perfect reconstruction algorithm can be 

dk' ° =d l + In £(<fcjt) / , m, / m-2~ , (5.5) 



20 combined with (5.2) . 

As mentioned above, the Lifting scheme is a 
special condition of the correction method. Examples 3 
through 5 can also be considered as the examples of this 
method. We next give an example of the Correction method 

25 which cannot be included in the group of Lifting scheme, 
and also which does not result in a closed form of 
compact support for biorthogonal filters. 
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Example 6 : S+P transform, which is similar to 
using following analysis filters . 



n 


-2 


-1 


0 


1 


2 


3 




0 


0 


1/2 


1/2 


0 


0 




-1/16 


-1/16 


15/32 


-17/32 


7/32 


-1/32 



While the synthesis filters do not have compact 
support, the S+P transform can be implemented as follows: 
(a) Decomposition 

(l)Take the decomposition step of Example 1, 
10 that is, compute 



dfc /0 — ^2k+if-^~ 0,1,'", Ml 1; 



and 



c£ = In d I + CaVi / 0 , - , N ± -2 , 



Int 



c n-l 



(2) Correction Step: Define S 0 = -1, S x = 1, T = 1 and 



1 11 



T,= — 



and now compute 
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(b) Reconstruction 

(1) Compute 



dl-^d^lni^ *cU+cl-cU-2d^ ^ k= ^_ 2 f f i; 
d^'°=d^Int^tSL 



(2) If N is an even number, compute 



or, if N is an odd number, we have 



(3) Compute 

c , 2°ic == ^ + c' 2 0 fc+ i/ k=Q / M ± -l 



Boundary Conditions 
There are two issues dealing with boundary 
filtering if the Lifting scheme or the Correction method 
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is used to generate the integer wavelet transformations. 
The first is how to process the boundaries which occur in 
the start-up wavelet transformations. The second is how 
to deal with the boundaries in the deductive formula. If 
5 the boundaries in the start-up wavelet transform have 
already been established, then those in the upgrading 
formula are relatively easy to establish. For the 
Lifting scheme, the boundaries in both steps should be 
processed in the same way. While, for the Correction 

10 method, according to (5,3) -(5,4), one has more choices to 
process boundaries in the second step. Therefore, the 
process by which the boundaries in the start-up wavelet 
transformations are established is discussed. Assume 
compact supported biorthogonal wavelets, ol ^ 

15 Suppose the original signal is ^ 3 For 

creating integer biorthogonal wavelet transformations, 
use the following symmetric extension: 

(1) If current biorthogonal filters have even 
length, the boundaries of the signal are 

20 extended as r - C» , Jc-'i*> / 

- it *■ * 

(2) If the filters have odd length, the 
following extension is performed 

Examples 1 through 5 use the boundaries given 
25 above. In Example 6, the start up wavelet transform uses 
the above boundaries but in the upgrading step, another 
boundary filtering is used. In addition, for arbitrarily 
sized images or signals, one can use the same technique 
described in the above examples to deal with this 
30 condition. 

As mentioned earlier, for many applications, 
lossless image compression is more important than lossy 
compression. The integer wavelet transforms described 
above provide the opportunity to compress without loss. 
35 It is also obvious that the integer wavelet algorithms 



can be used wherever ordinary wavelets are used, 
especially in signal and image compression. However, for 
most computers, the integer wavelet transform is much 
faster than other wavelets and it uses much less memory. 

Peak Signal to Noise Ratio (PSNR) 
Controlled Compression 

Peak Signal to Noise Ratio (PSNR) is a widely 

used quality measurement. PSNR controlled compression 

allows users to choose their desired PSNR for the 

compressed image. In each of the compression methods set 

forth herein, a user can selectively set the PSNR and the 

desired compression ratio, as well as the initial 

quantization and threshold levels for each quadrant of 

wavelet coefficients, to obtain the desired image 

quality. 

For example, the wavelet map of FIG. 3 shows a 
total of 10 regions (quadrants) . Each of these ten 
quadrants can have two additional parameters associated 
with them. The parameters define the quantization and 
threshold values for that particular quadrant. Since 
there are three planes for color (only one for gray 
level) the maximum number of parameters that the user can 
control is 60 — 10 for quantization and 10 for 
thresholding for each of the three color layers. In the 
case of a gray level image, there are only 20 parameters. 

If a compression ratio, or a quality factor 
which indirectly defines a compression ratio, is 
specified, then the user wants the compression ratio to 
remain identical over the changes in the parameters . In 
order to accomplish this, two parameters are monitored: 
the compression ratio and PSNR (peak signal to noise 
ratio) . The PSNR is defined as PSNR = 20 log 10 (X/MSE) , 
where the X is the average absolute value of the pixels 
in the compressed image and MSE is the mean squared error 
measured between the compressed and original image. 
Holding the compression ratio constant, the PSNR needs to 



increase to improve image quality. The way to increase 
the PSNR is to reduce the MSE . 

An iterative method can be used to adjust 
parameters to achieve the desired PSNR. The step are as 
follows : 

(a) Pick an initial parameter setting P 0 ; 

(b) Quantize the wavelet coefficients with P 0 
and calculate the corresponding PSNR; 

(c) If the PSNR is close to the desired one, 
stop and output the coded file; otherwise, get 
an adjusted vector AP 0 and set P 0 ** P 0 + AP 0 , 
go to step (b) . 

Progressive Decomposition 
Progressive decompression allows users to decode 
images at varying degrees of resolution, starting from 
the lowest resolution and progressing to the highest 
resolution. The advantage of this feature is that users 
can download small pieces of the coded file and view the 
image at lower resolution to determine if they want to 
download the whole image. Progressive decomposition can 
be used with any of the decompression methods previously 
disclosed herein. Progressive decomposition is 
accomplished according to the following steps: 

(a) Input the lowest bandpass component C 1 of 
the coded file and reconstruct the lowest 
resolution image 1°; 

(b) Display image 1°; 

(c) If the user is not satisfied with the image 
quality or the resolution is big enough for 
stop; otherwise, go to step (d) ; 

(d) Input the lowest three band-pass components 
HD 1 , VD 1 , and DD 1 successively in the current 
image file. Reconstruct the new image I 1 from 
C 1 , HD 1 , VD 1 , and DD 1 . Let 1° = I 1 ; go to step 

(b) . 



Image Map Editor 

The image map editor creates an image map over a 
compressed image file. This permits an image compressed 
according to one of the methods set forth herein to be 
easily integrated into a web page using an http link. A 
user selects one or several areas of compressed image, 
assigns one or more http links to the areas. The image 
map editor calculates the coordinates of the areas and 
outputs the HTML associate with the image. The user can 
add such information into program source code. Following 
is an example of such image map: 

<EMBED SRC="cow.cod" type="image/cis-cod" 

WIDTH="257" poly= "44, 45, 103, 78, 103, 86, 54, 

86, 54, 78", 

h re f=»http : //www. inf inop . com"></EMBED> 

Non-Uniform Image Compression 
The present invention allows a user to perform 
non-uniform image compression. Essentially, non-uniform 
compression is accomplished by dividing an image into one 
or more rectangles, each representing a matrix of image 
pixels. Each rectangle can be compressed by any of the 
methods disclosed herein. 

For instance, referring to the compression 
method of FIG. 8, integrating the non-uniform compression 
feature with the method allows a user to partition the 
image into several parts with different interests. The 
user can then compress these areas with different image 
and/or compression qualities. The parts can have any 
shape . 

The non-uniform compression feature can be 
incorporated in to the method of FIG. 8 as follows. 
Steps 100-102 are performed. Then, the user creates 
bitmap matrices defining the partitioned areas. Each 
area is then wavelet transformed. Different 
quantizations are then applied to the different areas 
according to the transformed matrices obtained above. 
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Split and Merge Wavelet Algorithm 
for Big Image Compression 

This algorithm allows users to compress large 
images by partitioning them into smaller pieces. The key 
5 is to divide the original image into several smaller 
pieces and compress/decompress them separately by using 
overlap and de-overlap technique. With this technique, 
the individually compressed pieces are equivalent to 
compressed whole image. The user does not see any edge 

10 effects in the decompressed image, which normally occur 
with conventional split and merge methods. 

Also, with this algorithm, users can selectively 
decompress the whole image or choose a specific part to 
decompress according to an image map created during the 

15 compression phase. The algorithm is preferably 

implemented as a software program executing on a general 
purpose computer. 

There are two ways to compress an image by 
splitting it: automatically or interactively. The 

2 0 automatic approach is transparent to users since the 

algorithm will automatically split to the image according 
to the characteristics of the computer used to perform 
the compression. Using the automated method, the 
algorithm first detects the size of the source image and 

25 the memory size of the host computer. Next, the image is 
split into several pieces with a predetermined number of 
pixels overlapping according to the image size and 
computer's memory. Overlapping pixels are those that 
appear in more than one piece of the split image. 

30 Each piece of image is compressed in order 

according to any of the methods disclosed herein from the 
image resource. 

The split image is decompressed as follows. 
First, the headers of the compressed image pieces are 

35 read to determine their order and compression parameters, 
such as quantization thresholds and decomposition levels. 
Next, each piece of the image is decompressed and de- 
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overlapped. Merge all pieces together in the proper 
place for display. 

Using the interactive method, a user can 
indicate how many blocks they want to divide the image 
5 into and how many pixels they want for overlap. To 

compress an image according to this approach, the size of 
the source image is first detected. Then, the user's 
choice for the number of blocks and number of overlapping 
pixels is entered. Next, the image is divided into the 

10 pieces according to the user's choice and the size of the 
image. Finally, the individual pieces are compressed 
according to one of the methods disclosed herein. 

The interactively split image is decompressed as 
follows. First, the header of the coded image is read. 

15 Next, an image map is displayed for the user to look at 
what the image context is about. The user can then 
choose to display entire image or a specific piece of 
image. If user chooses to display a single piece of 
image, the algorithm finds the position of this coded 

20 piece and decompresses it. If the user instead chooses 
to display the entire image, the algorithm decompress 
each piece of image and de-overlaps it. All pieces are 
then merged together in the appropriate display location. 
Example A, below, shows further technical 

25 details related to the present invention. 



-48- 

Attached in Appendix A is a listing of a 
computer that is related to the present invention ♦ 

While specific embodiments of the present 
invention have been shown and described, it will be 
5 apparent to this skilled in the art that the disclosed 
invention may be modified in numerous ways and may assume 
many embodiments other than the preferred form 
specifically set out and described above. Accordingly, 
it is intended by the appended claims to cover all 
10 modifications of the invention which fall within the true 
spirit and scope of the invention. 
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1.0 Quality Compression Optimization 

The following sections deal with the improvement of the compressed 
image quality. As stated in the report introduction, we believe this is 
the last significant major problem to be addressed in the still 
imagery compression system. 

1.1 Introduction 

The issue is the mechanism which can be used to improve the quality 
of the image based upon the nature of the parameters used in the 
compression process. We think this is an important issue, and in our 
experimentation, we have found fairly striking results. For example, 
if we hold the compression ratio constant, we can compress an image 
and obtain on a subjective scale of C, where 

• A is no observable defect, 

» B is observable but not noticeable, 

• C is quite noticeable, but not distracting from the image, 

• D is very noticeable and detracts from the image, 

• E is unacceptable. 

If we now change the parameters by a hand optimization, we find we 
can change the subjective evaluation from a C to a B with the 
compression ratio left alone. We believe this is significant, in that it 
guarantees a compression system which is tailored for each image 
independently, rather than have each image compressed by the same 
set of parameters irrespective of the image content. 

To review the process of compression, consider the following figure, 
Figure 49* 
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Figure 49 

RGB Image in 24 Bit Color Depth Showing Transform to YIQ 

Figure 49 shows the relationship between the RGB and YIQ color 
representation and the processes which take place in the algorithm 
as this data is transformed into the final lossy set of wavelet 
coefficients.. The processes which apply to the imagery are shown as 
heavy arrows with the process identifier shown as part of the arrow. 
If no process number is present, then the arrow is just a passive link 
between processes and data. The important point to note is that in 
color imagery, we deal with three images (one luminescence, and two 
color planes). The Y component is critical, while the IQ components 
are less sensitive to error introduced by the compression system. 



The 



processes shown in Figure 49 are as follows: 



• (1) Transform the RGB format into YIQ format, using long 
integers. This format is only an approximation of the YIQ format. 

• (2) Transform the YIQ planes into a wavelet decomposition using 
our own integer wavelet transform. This produces the result 
shown in Figure 50, but for each plane. 

• (3) We have shown an alternative process which is an optional 
down sampling for the IQ color planes. This down sampling may 
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be done once or twice to produce two image planes either one 
fourth or one sixteenth the size of the original plane* If this 
process is to be done, it will be accomplished prior to the wavelet 
transform of process (2). 

* (4) Here the first step in the loss occurs. The wavelet coefficients 
are now quantized to a number of levels depending upon which 
quadrant is being processed, and the desired compression or 
quality factor. 

* (5) Simultaneously with step (4), the wavelet coefficients are 
being matched against threshold values, and if the values are less 
than the established threshold values specified, then the resultant 
value is set to zero. 

* (6) The last step in the process is to entropy compress the 
resultant coefficients using either Arithmetic, Run Length, or 
Huffman, of Huffman and Run Length combined. The key issue is 
the amount of compression desired against the invested time 
required to get that level of compression. 

The issue now, irrespective of the down sampling or not of the 1Q 
components, is the fact that we process the three planes into five 
levels in a decomposition as shown in Figure 50. From this figure, 
one can see a total of 16 regions (quadrants) which are defined by 
the numbers 1 through 16. Each of these sixteen quadrants have two 
additional parameters associated with them. The parameters define 
the quantization and threshold values for that particular quadrant. 
Since there are three planes for color (only one for gray level) the 
maximum number of parameters that the user can control is 96 - 16 
for quantization and 16 for thresholding for each of the three color 
layers. In the case of a gray level image, there are only parameters 
for one layer* 

Our experience has shown the parameters for an image are very 
sensitive in some cases, and not in other cases. In order to measure 
this sensitivity, we generated the variance of the wavelet coefficients 
in the 16 quadrants. Table 1 provides these values for each of the 
three planes. 
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Figure 50 

Decomposition of a Plane into Five Levels 
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-L2M.8 295,6 



Tulips 

jyavglct variangg- 



164.2 
134.6 
28.9 
276.1 
274.3 
124.8 
225.7 
298.1 
114.2 
174.8 
285.1 
107.9 
135.4 
245.0 
89.3 
7. 4 Q8 .6 . 



L 

27.3 
24.9 
4.6 
57.7 
67.3 
22.7 
73.2 
107.3 
35.5 
73.9 
128.2 
47.8 
75.6 
144.0 
49.1 
690.4 



6.6 
5.0 
1.1 
12.9 
12.4 
5.0 
13.7 
16.2 
6.8 
10.7 
14.9 
6.7 
8.7 
11.2 
5.1 
77.9 



Table 1 

Wavelet Coefficient Variance by Numbered Quadrant for Two Images 
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The clear information to be gained by the numbers in Table 1 is the 
images are quite different, and the quantization or threshold levels 
set for all images will only be an approximate solution at best. The 
optimum solution would be to have the quantization and threshold 
values set according to the variance values. Such settings could be 
found in a table with various ranges, and for each such range, the 
parameters of interest could be defined. This would give a more 
optimal solution, but still not the optimal solution. In order to get 
optimality, one would need to search over the variable space using 
the near optimal settings to find the actual best values for the 
parameters. 

As the values in Table 1 grow, the implication is a finer mesh size for 
quantization, That is, the number of bits one wishes to allocate to the 
output could be varied by quadrant. Those quadrants with large 
variances will utilize more bits, while those with low variants will 
utilize fewer bits. In this way, the number of bits resulting from 
quantization will remain the same, but their allocation will differ 
depending upon the nature of the image. 

1.2 Approach 

The solution to the problem posed in the previous section is to 
determine how the ninety-six parameters interact with one another. 
The problem is a bit more sophisticated than just measuring 
parameters, however. The issue is with each parameter change, the 
compression ratio will change. If a compression ratio, or a quality 
factor which indirectly defines a compression ratio, is specified, then 
the user wants the compression ratio to remain identical over the 
changes in the parameters. In order to accomplish this, there are 
two parameters which we must monitor: PSNR (peak signal to noise 
ratio which is defined to be PSNR = 20 logjo (X/MSE) where the X is 
the average absolute value of the pixels in the after image and MSE 
is the mean squared error measured between the before and after 
image) and the compression ratio. The compression ratio must be 
held constant, and the PSNR needs to increase, and the way to 
increase the PSNR is to reduce the MSE. 

The difficulty with this system as described is in many cases, small 
changes in the parameters introduce significant changes in the MSE. 
Also, we believe, the parameters are not independent. We have also 
seen images where the parameters can be changed in one way, then 

0' 5 
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altered, and the results are exactly the same. This indicates the 
optimal value is not a single point, but rather something like a plane 
with little slope. 



1.3 Status 



We have established the rules under which the optimal solution will 
need to exist, and are at the moment writing software to measure the 
variance within the Lightning Strike environment. Once this is done, 
we will being examining many images to sec how close we can 
determine the optimal parameters for a defined set of variances. 
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CIS-2 Image Compression Algorithm 
HONGYANG CHAO 
Part I: Brief Review of LSIC 3.0 

1. Introduction 

CIS-2 (temporary name), which has been being used in Lightning Strike 3.0 image 
compression software, is a wavelet based image compression algorithm. CIS-2 has 
following inventions: 

• Integer reversible wavelet algorithm with Property of Precision Preservation; 

• Subband oriented quantization and related entropy coding; 

• Wavelet lossless compression for color and gray images; 

• Progressive transmission algorithm for color bit compression; 

• Progressive transmission and decompression algorithms; 

• Non-uniform image compression algorithm; 

• Quality based wavelet coefficient quantization tables; 

• Attached optional post-processing filters; 

• Image map editor; 

• Optional peak signal noise ratio controlled compression; 

• Special split and merge wavelet compression algorithm for very big image 
compression without any boundary effects ; 

• Image dependent parameter optimization . 

2. Main steps of the algorithm 

In Lsic 3,0> three kinds of different image compression methods arc included: 
Method 1 : Quality controlled wavelet based compression 
Method 2: Color bit depth compression 
Method 3 : Wavelet lossless compression 

Section 24-23 will give brief description of above method The details will discuss 
later. 

2,1. Main step of method 1 

Figure I and Figure 2 give the flow charts of the image compression and 
decompression of method! respectively. Every step in both compression and 
decompression has lot of details, which will be described later, 
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Figure 1: Compression flow chart for Method 1 
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Figure 2: Decompression flow chart for Method 1 
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22. Main step of method 2 

This method based on using less number of colors to approximately represent 
original images. Following figure gives the main step of the algorithm for the 
compression and decompression. 
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Figure 3: Compression flow chart for Method 2 
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Figure 4: Decompression flow chart for Method 2 



23, Main steps of method 3 

The main steps of method 3 is almost as same as method 1 , However, at the e 
step we use different methods. Following are its compression and decompression 
flow charts: 
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Figure 5: Compression flow chart for Method 3 
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Figure 6: Decompression flow chart for Method 3 



3* Brief Description for Other Features 

Most Features (or inventions) are included in above three compression methods. 
Following is the brief introduction for some inventions list above. 
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34. Progressive decompression 

This algorithm allows users to decode images from the lowest resolution to 
highest resolution. The advantage of this feature is that users can download small 
piece of the coded file and view the image at lower resolution to determine if they 
want to download the whole image. 

Steps: 

(a) Input the lowest pass component LL°of the coded file and reconstruct the 
lowest resolution image 7° ; 

(b) Display image 7° . If the user doesn't like it or the resolution is big enough for 
, stop; otherwise, go to next step; 

(c) Input the lowest three band-pass components #1° , I// 0 and HH 0 
successively in the current coded file. Reconstruct the new image /' from 
LL\ HL\ LH* and HH*. Let Z 0 -/ 1 , go to step (b), 

3-2. ISon-unifonn image compression 

The algorithm allows users to divide the image into several parts with different 
interests and compress these areas with different qualities. The areas can have any 
shape. This algorithm is only available for method 1 , 

Original image goes though all of the procedure except quantization part, which 
follows the steps below: 

(a) Creating the bitmap matrices related to the areas chosen by the user; 

(b) Wavelet transform to every bitmap matrix; 

(c) Different quantization in different areas according to the transformed matrices 
obtained above step. 

3.3. Peak Signal Noise Ratio (PSNR) controlled compression 

Peak Signal Noise Ratio (PSNR) is an image quality measurement used by most 
professional people, PSNR controlled compression allows users to choose their 
desired PSNR for the compressed image. 

The related algorithm is an iterated system: 

(a) Picking an initial parameter setting P 0 ; 

(h) Quantize the wavelet coefficients with P 0 and calculate the corresponding 
PSNR; 

(c) If the PSNR is close to desired one, stop and output the coded file; otherwise, 
get an adjusted vector A? 0 and set P Q <~ ? 0 + AP 0 , go to step (b); 
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3*4. Attached optional post-processing filters 

Users can choose any number of following processing filters at their compressing 
time. The desired results can stored in the coded image file, and, anyone who 
decompress the coded file will see the same result immediately. 

• Sharpening images 

• Smoothing images 

• Improving the visual quality 

• Brightening the images 

3*5. Image map editor 

Image Map Editor create a image map over Lsic3,0 compressed image file. User 
selects one or several areas of compressed image, assigns the http links to the areas, 
then, Image Map Editor calculates the coordinates of the areas and outputs a HTML 
associate with the image. User can add such information into his/her source code. 

Following is an example of such image map: 

<EMBED SRO"cow.cod" type = "imagc/cis-cod" WIDTH* "257" poly- "44, 
45, 103, 78, 103, 86, 54, 86, 54, 78", hre£= "http;//www.infinop.com >, x^EMBED> 

3*6. Split mod merge wavelet algorithm for very big image compression 

This algorithm allows users to compress very big image by an ordinary machine. 
The key is to divide the original image into several smaller pieces and 
compress/decompress them separately by using overlap and dis-overiap technique. 
With this technique, the compression/decompression piece by piece is equal to 
compress/decompress the whole image together, which means users won't see any 
edge effect at decompressed image which appears at general split method. 

Also, with this algorithm, users can either decompress the whole image or choose 
the specific part to decompress according to a image map we create for the division . 

3 J. Image dependent optimized parameter setting 

This algorithm allows user to get the best (or almost best ) image quality at the 
desired compression ratio by choosing image related parameter setting. 

3,8. Integer reversible wavelet algorithm with PPP property 

See attached unpublished paper titled as "An Approach to Fast Integer Reversible 
Wavelet Transformations for Image Compression" 
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3.9. Integer color transformation 

This algorithm is a integer reversible transform which has been used in lossless 
color image compression (Method 3) for Lsic 3.0* 

The algorithm transform RGB color components to a new set of color 
components Y-Nb-Nr: 

Forward transform RGB to Y-Nb-Nr: 

r*G + Int(Y), 
M>«B-int(f), 
tfr = *-im(f). 
Inverse transform Y-Nb-Nr to RGB: 

R~Nr + lnl{i\ 
S-Afc + Int(£), 

3*10* Subtend related Quantization and entropy coding 

This entropy coding method is just designed for wavelet based image 
compression. The main idea is to take the advantage of different quantization at 
different subbands and encode each band according to its content This method 
reduce the coding cost greatly. 



CIS-1 Image Compression Algorithm 



HONGYANG CHAO* 
Computer and Information Science Inc. 

1. Introduction 

CIS-1, which has been being used in Lightning Strike image compression software, is a 
wavelet based image compression algorithm. CIS-1 has following advantages: 
o Reach almost optimal compression ratio; 

o Keep the major characteristics as more as possible. In other words, it reduce 

insignificant components gradually according to human visual system, so that people 
can still accept the image quality at the extremely high compression ratio; 

o Fast 

2. Main steps of the algorithm 

Figure 1 and Figure 2 give the flow charts of the image compression and decompression 
respectively. Every step in both compression and decompression has lot of details, which 
will be described later. 

Input O riginal Image 
Display Image 

V 

Image Transformations 
Quantization and Thresholding 

, r , 

Encoding 

V 

Output Coded Image File 
Figure 1: Image compression 



* 



Input Coded image file 



Decoding 



De-quantization 

i 



[averse Image Transformations 



f i 

post Image Proc essing if Necessary 





Display Compressed Image 



Figure 2: Image decompression 

3. Image Compression 

For the compression, we only have to describe three parts: image transformations, 
quantization and thresholding, and entropy coding. 

3.1. Image Transformations 

The image transformations involved in this algorithm include color transform (for color 
images) and wavelet decomposition ( for both gray level images and color images). 

(a) Color transform 

In general, input color images are based on RGB color model, such as 

TIFF or BMP images. In order to get high compression ratio, it is better to change RGB 

color model to other color models, such as YIQ or YUV models. 

RGB to YIQ: 

(Yl [0.299 0.587 0.114 T*l 
1/ 1 = 1 0.596 -0.275 -0.321 1 g \. 
Ld Lo.212 -0.523 0.311 ItfJ 

RGB to YUV: 




|"r1 [0.299 0.587 0.1141*1 
I t/i = 1 —0.148 -0.289 0.439 I G L 
\y\ [.0.615 -0.515 -0.1 IfiJ 



(b) Wavelet decomposition 

The purpose of wavelet transform is to represent the original image by different basis to 
achieve the objective of decollation. There are a lot of wavelets which can be used in 
this step. In CIS-1, we use a wavelet which results in the following algorithm: Suppose 
C° =[4]^* (j = -I; * = 0,— 9 N-l) is original image, where M and N are 

integers which have the common factor 2 l (L is a positive integer). After one-level 
wavelet decomposition, we will get four parts as shown in figure 3. 





Wavelet 


6 


HD 1 


Transform 


VD 1 


DD 1 



Figure 3, Wavelet image decomposition 

We call C 1 = [cjj (;' . 0,-, ¥ - 1 ; Jfc « 0 t - -y? - 1) the blurred image of C°, HD 1 the 
horizontal high frequency part of C° , VD 1 the vertical high frequency part, and DD 1 the 
diagonal ones. Setting C° = C 1 , we can repeat the same procedure L times or until the 
size of the new blurred image C 1 is small enough. Therefore, we only have to give the 
algorithm for one level decomposition: 

(1) Let C° - rC° , r >0 is a factor which can be changed for different needs. 

(2) Transform for image columns: 
o For * = 0,« calculate 

2 (3.1.1) 

o For £ = 0,» calculate 



L 0 

| c o*-<i,a 2 1 

I 2 

-1 -0 "Jl 



(3.1.2) 



(3) Transform for rows: 

o For j = 0, — , ¥ - 1 , computing 

Mj.* — 



(3.1.3) 



and 



H = \ QjM-i - 2dj* + cU +1 ), A = 1,. . .f - 1. 

| c 7o 2 ' 

M 0 > *«I,-,*-2, (3.1.4) 

i i 



o For ; = 0, • • # - 1 , computing 



(3.1.5) 



and 



U-^,- ^-^ 1 , *-l.-,*-2, (3.1.6) 
(4) d = [c)4 HD« = VD' = [<] and DD 1 = j = 0, , ■ ,f - 1 

Remark:. If it is necessary, we also can use matrix multiply 

Wavalet Coefficient Image of / levels = W,C C W* . 



Here, W ; is the transform matrix for / level wavelet decomposition. 
3*2. Thresholding and Quantization 

Both thresholding and Quantization allow us to reduce accuracy with which the wavelet 
coefficients are represented when converting the wavelet decomposition to an integer 
representation- This can be very important in image compression, as it tends to make 
many coefficients zeros-especially those for high spatial frequencies. 

After L level, for example L & 3 y wavelet decomposition, we get the wavelet coefficients 
of the original image as plotted in Figure 4: 



c 5 


HD 3 


HD 2 


HD 1 


3 

VET 


DD 3 


VD 2 


DD 2 


VD 1 


DD 1 



Figure 4. L-3 wavelet coefficients distribution 

(a) Thresholding 

In algorithm CIS-1, we use multilevel uniform thresholding method: Let 

be the chosen thresholds, where /, is the threshold for / th (/ = 1, - -,L) level and t Ln is a 
threshold for blurred image C 1 . Thresholding is to set every entry in the blocks , 



HD', VD ; and DD' (/ « 1, • • to be zeros if its absolute value is not greater than the 
corresponding threshold. 



Remark For color image, we can have three threshold vectors which correspond three 
different color bands, such as Y, I and Q. 

(b) Quantization 

Quantization is to scale the wavelet coefficients and truncate them to integer values. In 
CIS-1, we use the quantization table shown in Table 1 to implement it 



_1 

?JH> 


1m 


• • • 


„L 

1m 




_1 


IvD 


• • • 


in 




<l l nn 




• • • 


Inn 





Table 1. Quantization table 
Here, the entries q l m are quantization factors for blocks HD' (/ = 1,— ,Z) , and q 
for blocks VD' and DD' (/»!,•• * y L) respectively, and the factor q^ is for the most 
blurred image C 2, . All the factors are integers between 0 and 255. The quantization 
scheme for the block HD / (/ = 1, ... ,1) is 
— hd! • ' 

U*-romd { !fy m ).j«0,'»,$-li *-0,-,f-l. (3.2.1) 



/ 

DD 



max 



Here, hd}± (J = 0, • • % % - 1; A = 0,- • - 1) are quantized wavelet coefficients in block 
HD' (/si, •••,!), 

0i*S(#/2'-i) 

and the function rou/zrf (x) gives the nearest integer of x . The scheme of quantization for 
other blocks are the similar to (3 .2.1). 

Remark For color image, as the same as thresholding, we can have three separate 
quantization tables for different color bands. 

3.3. Entropy Coding 

Here, the encoding means the lossless compression for the wavelet coefficients. It is 
divided into two parts: Coefficient arrangement and entropy coding (Huffinan or 
arithmetic). 



6-<r 



4. Decompression 
4*1 Decoding 

Decoding, just as encoding, can be divided into two parts: Entropy decoding (Huffman or 
arithmetic), and coefficient rearranging. 



42 Dcquantization 

After Decoding, we get quantized wavelet coefficients in 3 *L+1 Blocks* Dequantizing 
uses the same quantization table as quantizing, and the scheme as follow: for / = 1, • • -,I 
^ ^.max'rc, : ^ (421) 

(4.2. 1) allows us to get the approximate coefficients for the blocks HD' (/ = 1, . . .,1) f 
which is shown in Figure 4 . The dequantizing scheme for other blocks are similar to 

(4.1.2) . 



43 Inverse Image Transformations 
(a) Wavelet reconstruction 

We are going to describe the algorithm for one-level reconstruction which is plotted in 
Figure 5. 




Inverse Wavelet 
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HD 1 


Transform 


VD 1 





Figure 5. One-level wavelet reconstruction 



(1) Inverse transform for rows: 
o For j »0,—,^-l, calculate 



k «l,..y? -2, 



(4.3.1) 



j^ir-U " v 4.£5» +<#),i! i l- 



I 



and 



(4.3.2) 



o For ;-0,— ,f -1, calculate 



~ C Jk + 



2 



I 



2 



(4.3.3) 



and 



Z 1 =c l -Ihd 1 
1 



(4.3.4) 



(2) Inverse transform for column: 

o For k - 0,- •-, N - 1 .calculate 



r 



-0 



;1 , 3>'t+^U 

2 

A +53 



1 C 2 - /+l> fyk 



(4.3.5) 



and 



c° «£ D -2<? 

(3)c;,=c;,/r, y-0 f .»,i/-l; t.0 r ^-l.C°.[c^. 



(4.3.6) 



(b) Inverse color transform 

For color image, we have to do inverse color transform 
o YIQ to RGB 

H.000 0.956 0.621 JY] 
IgUI 1.000 -0.272 -0.64711 l\ 
[b\ Ll.000 -1.106 1.703 JLfiJ 



o For y«0,—,^-l f calculate 

|*M" c ,/o + 2 



(4.3.2) 



(4.3.3) 



and 



cJo=*V 2 Ko> 



5U =^-> 

(2) Inverse transform for column: 

o For = 0,- • N - 1 , calculate 



and 



(4.3.4) 



(4.3.5) 



U- 0 



(4.3.6) 



(?) «m /r ' y-o,-,w-i; *=o,-.-,//-i.c°=[c; t ] yx1 . 



(b) Inverse color transform 

For color image, we have to do inverse color transform 
o YIQ to RGB 

[R] Tl.000 0.956 0.621 JY~\ 
I G I = 1 1.000 -0.272 -0.647 II / 1 . 
W Ll-000 -1.106 1.703 JLeJ 



o YUVtoRGB 

lol- 

W 



4.4 Necessary Post Image Processing 

(a) Color Quatization 



n.000 0.000 L140 Jy~\ 
1 1.000 -0.395 -0.581 1 U\ 
Ll.000 2.032 0.000 J_kJ 
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Reversible Wavelet Transforms for Image Compression* 
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Abstract 

In this paper, we propose a general method for creating integer wavelet transforms which can be 
used in both lossless (reversible) and lossy compression of signals and images with arbitrary size. 
This method allows us to get a series of transformations which are very close to the corresponding 
biorthogonal wavelet transforms or some non-orthogonal wavelet transforms, but can be calculated 
with only integer addition and bit-shift operations. In addition, the integer wavelet transforms 
created in this paper possess a property of precision preservation (PFP). This property is very 
useful for conserving memory in both compression and decompression, and speed up the whole 
procedure in some applications. The motivation of this paper comes from the lifting scheme [1] 
and S+P transform [3 J. 



* This work has been partially supported by the US Navy under SBIR Contract N00039- 
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and the Science Foundation of Zhongshan University. 

Chao-Fisher I 



6-^ 



MAR-11-1997 12=13 



CIS 



P. 09 



1. Introduction 

The wavelet transform has proven to be one of the most powerful tools in the field of image 
compression. Theoretically* the wavelet transformation is lossless, but since all computers have 
only finite precision, most of transformations are lossy in practice, even when we use floating 
point calculations. On the other hand, integer calculations are much faster than floating point for 
virtually all computers; and integer computations are much easier to implement in hardware which 
is more important in some applications. The memory utilization of integers is also a positive 
consideration. The difficulty is, if we directly use integers in the wavelet transform and its inverse 
without some proper considerations, it will cause the loss of accuracy. For some important image 
applications, the user wants to have complete control of the precision in which the image pixels are 
represented during the compression process, and thus prefers to have the image compressed from 
lossless to lossy. 

Lossless compression is also veiy important for images found in such applications as 
medical and space science. In such situations, the designer of the compression algorithm must be 
very careful to avoid discarding any information that may be required or even useful at some later 
point. From the academic point of view, it is also very interesting to have a compression scheme 
which has very fast performance, and which can exactly reconstruct the image when necessary. In 
addition, it is also very useful to have some wavelet transforms which exhibit the property of 
precision preservation (PPP), which can be utilized in the computer which has limited precision 
and limited memory without losing any precision during the computation. 

In this paper, we are going to describe two general methods from which one can get the 
integer wavelet transform desired. All of the wavelet transforms from the methods given in this 
paper possess the property of precision preservation (PPP), We draw on the work of several other 
authors who have already contributed to this area [2-3], where some specific examples were 
developed. However, this paper presents a more general method which allows one to sec several 
new results as well as those presented and acknowledged prior to this work. 

This paper is organized as follows: Section 2 and 3 give some examples of integer wavelet 
transforms. The examples in section 2 are the starting point for our approach, and the examples in 
Section 3 show the steps and motivation of our general method. Section 4 indicates how one can 
use the lifting technique to create an integer biorthogonal wavelet transform. The Correction 
technique to generate more general integer wavelet transforms is described in Section 5, Section 6 
describes how to process boundaries in order to apply the integer calculation in finite sized images 
or signals. In Section 7, we prove the integer wavelet transforms developed by both the lifting and 
correction method possess the property of precision preservation (PPP). Some example images 
are also shown in this section. The last section, Section 8, provides the conclusion to this paper. 
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2* Basic integer wavelet transformations 

We provide the following two examples as the starting point for our new method. For the 
sake of convenience, length, and simplicity, we only discuss the algorithm for a one level 
decomposition and reconstruction and only for a one dimensional signal. The extension to two 
dimensions is immediate as the rows and columns can be treated into a sequence of one 
dimensional signals. For the following examples, assume that {c?}^ is the original signal where 
the superscript indicates level and the subscript indicates a particular point in the signal. Also, 
{ c iX* 211(1 {^j^o* a« its decomposition parts at the first level Here 

if N is an even number, 
if N is an odd number ; 

{ c » Xlc ^ 315 * ow ft 1K ! uenc y (0 P 3 * anc * high frequency {h) part, respectively. For 

multi-levels, we just treat {cijf^ 1 as {cjj^j and repeat the procedure again. 



EiampUi: A (2,2)*wavelet transform by integer calculation. 

This transformation is similar to a variation of the Haar wavelet transform which uses low 
and high pass analysis (decomposition ) filters given as: 



n 


0 


1 


I 


1/2 


1/2 


s. 


1/2 


-1/2 



(1) Compute 

(2) Compute 



4 =4-^, *=0,-,Af,-l. 



c\ *Int(^-)+c 0 ^, k = 0,- -2. 



if N is an even number, 



(2.1) 



(2.2) 



if N is an odd number. 
Here, Int(x) is an arbitrary rounding function which may have different interpretations. 
For example, Int(x) can be the integer which is nearest to x , or Int(x) may be any integer 

which satisfies x - 1 < Int(x) S x , etc. It is easy to see that all entries in both {c* and 
arc integers. 
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From (2.1M2.2), wc can easily get the following integer reconstruction algorithm: 

(b) Reconstruction 

(1) If N is an even number, compute 

or, if N is an odd number, we have 

(2) Compute 

Remark Since (2.1M2-6) are not linear because of the rounding operation Int(x) , this 
means the transformation order becomes significant. For instance, if the decomposition 
was applied first to the columns and then to the rows, the inverse transformation must be 
applied first to the rows and then to the columns. 

faampit 2 s Lazy wavelet transform. 

The Lazy wavelet transform does not do anything. However, this illustrates an important 
concept The corresponding inverse transform is nothing else but sub-sampling the even 
and odd indexed samples. Decomposition and reconstruction can use same formula as 
follows: 

* = 0, ■ 

Examples 1 and 2 are not good transforms for image compression, but they are simple. 
Much better transforms can be achieved from these two* As suggested above, we consider them 
only as a starting point for our integer, reversible, wavelet transform algorithm* 

We must mention that there is another interesting property in the above two transforms 
which may not be easily seen* If the values of the signal pixels are represented by a finite number 
of bits, say one bit or one byte, we can still use the same number of bits to represent the result of 
the forward transform within the computer itself because of the complementary code property. 
While, from the reconstruction algorithm, the computer will get back the exact original signal 
through the same complementary code property. We call this property a Property of precision 
Preservation (PPP) for these wavelets. 



(2.3) 

(2,4) 
(2.5) 
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It is known that the general values of the high frequency wavelet coefficients are small, and 
all higher levels in the decomposition also provide generally small values in the high frequency 
band. This allows the preservation of precision during the computational stage of the wavelet 
coefficients. Now, the complementary code property, the other aspect of the PPP property is a 
well known characteristic of integer arithmetic as done by the computer. Consider the computation 
of the difference of two integers given as c = b-a and the inverse computation of a » b • c. The 
nature of the computation within the computer can be specified as follows: 

[*-fl if -2 H ~ x $b-a<2^-\ 

c m =<~2*+i-a if b-a>2 q ~ ] 
2* + b-a if b-a<-2*~ x 



and the inverse is 



h-c n 



2*+2>-c m 



if -2*- ] $b-c m <2*- l -\ 
if b-c m ±2*- { 
if b-c m <-2«- 1 

where the m subscript indicates the internal representation, and the range of the integers a, b, c is 
[-2** 1 % 2 9 ' 1 - l]. The internal representation of c w when it is outside the range, its appearance is as 

a two's complement number, so the representation may not be the same as the external 
representation of a However, the same complementary code for the a m will cause the internal 
representation to be identical to the external representation of a. For example, if we let b=2 
(00000010) and a=-727 (10000001) then c m has the internal binary value of (10000001) when 
qm4. With a value of -127 for c mt the inverse value for a m will just be a. 

In fact, for Example 2, this property is obviously true. While for Example 1 , if the range 
of the pixel values is within a finite number of bits, say q, we can only use q bits as the working 
unit, which means the value of transform coefficients will also be within the interval with length 
2 9 , say [-2 r \ 2** 1 - lj. Due to the nature of computation on a machine, most machines will 
implement (2.1M2.2) automatically as follows (the complementary code property): 

if ^'sc&-c^<2* 



<%t ~Cj**» 



2« + 



-2«, 



( C 24 ~ C M+1^ 



(2.6) 
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4-< 



A 



Int(^-)+c«U if •2*- , Mnt&+c 2 V 1 <2'-', 



*»"<y)+4*>-2'. if Tnt(^.)+c»^2'-', 
Int(~)+cL t + 2'. if Int(4-)+^<-2 H . 



(2.7) 



While the reconstruction algorithm (2.3) and (2.3) will be implemented by the computer itself 



as 



ci-Iht<4L), 



c^,= 2'+^-mt(i)j, 



1 N 



c{-lnt(^-) 



if -TTst-tatffXV, 
if c |-Int(4')<-2«- 1 , 



-2', if ci-IntrA)^ 



4 - 



if -2^Srfi + 4 +1 <2»- 1 , 
^+c^+2», if rf{ + c&„<-2«-», 



4 



if dl+c^Zl*-*. 



(2.8) 



(2.9) 



we 



It is obvious that (2.8)-(2.9) are just the reverse of (2.6>(2.7). It is also easy to see that if 1 
properly take advantage of the bound in the coefficient sire mentioned above, the algorithm can be 
implemented using a minimal amount of storage. 

3. More Examples and Additional Analysis 

In this section we are going to give more examples which will give some motivation for our new 
approach. 

Fjamplf 2 : A (2,6)-wavelet transform by integer calculation [2]. 
This transformation is similar to using following analysis filters 



n 


-2 


-1 


0 


1 


2 


3 


h. 


0 


0 


1/2 


1/2 


0 


0 


h 


-1/16 


•1/16 


1/2 


• 1/2 


1/16 


1/16 



(a) Decomposition 

Decomposition starts with Example 1 at step (1) and (2), and then upgrades the high 
frequency component at step (3): 
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(1) Compute 

(2) Compute 



(3) Compute 



f <-> 

Inl *~2~) + cJ5-i • if N is an even number, 
if#isanodd number. 



and then, if N is even, calculate 



else, calculate 



(b) Reconstruction 



rfV, = Int(W 



The reconstruction algorithm is identical to the decomposition algorithm, except 
running "backwards". 



tt is now 



(1) Compute 



and uien, if N is even, calculate 



else, calculate 



#W _t-^ C ^!-3 ~ C W,-I. 



(2) If AT is an even number, compute 



Chao-Fisher 7 



tWt-li-1997 12^21 



CIS 



P. 15 



or, if N is an odd number, we have 



(3) Compute 



We see in step (2KJ) above, that they are just the same as shown for the reconstruction of 
the (2,2)- wavelet transform (Example 1). 



Rr ff m P u 4. a (1,3) -wavelet transform by integer calculation. 

The following nonlinear transform is a variation of the transform which uses biorthogonal 
analysis filters: 



n 


•1 


0 


1 


K 


1 


0 


0 


t. 


1/4 


-1/2 


1/4 



(DSet 



(a) Decomposition 

This decomposition starts with the Lazy wavela at step (1 ) and upgrades the high 
frequency component at step (2): 

rfl»c^. Jk=0, -.M,-l.' 
(2) If N is an even number, calculate 

Otherwise, if N is an odd number, calculate 

(b) Reconstruction 

(DSet <&»cj, M>.-,A{-t; 

(2) If is an even number, calculate 



j 

i 
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Otherwise, if W is an odd number, calculate 
4.,= Int( 



Eiiniglc ft A (5,3)-wavelet transform by integer calculation. 

This transformation is also similar in function to using the biorthogonal analysis filters. It 
is given by 



n 


-2 


.1 


0 


1 


2 




.1/8 


1/4 


3/4 


1/4 


-1/8 


in 


1/4 


•1/2 


J/4 


0 


0 



(a) Decomposition 

This decomposition starts with Example 3 at step (1) and upgrade low frequency 
components at step (2): 

0) Set c]*°=c£, JW).-".*;-!; 

If N is an even number, calculate 



ty.p 



Otherwise, if TV is an odd number, calculate 



0 0 



(2) If N is an even number, compute 

4 = 4-°-Int(^.), 



c^ = ci%-Int( 



Otherwise, if N is an odd number, calculate 
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.c{=ci-»-Int(^kt£L), Jfc = l,.,^-2, 
4 

(b) Reconstruction 

(1) Compute 

4=ci + lnt(^i), t.l,.,*, -2, 
Then, if N is even, calculate 

&:=4 r ,+Int( ^' ), 
else calculate cjj^ = 4 (H + Int(«-^-) . 

(2) Compute 4,1 = ^ ^^ )-^, -2, 

Then, if N is even* calculate cj^, = c£_ 2 - d } Mr} . 

The FW> property for Example 1-2 mentioned at the end of the previous section is also 
applicable for these three examples. It is obvious these three transformations are not really linear, 
but they are similar to the one using the corresponding filters given above. Especially, the filters in 
Example 3 and Example 5 belong to, with minor modification, the group of the best biorthogonal 
filters for image compression according to both our experience and the conclusion of [4]. 

Also, from the above three examples, we can note that if we begin with integer (linear or 
nonlinear) wavelet transformations and then use some proper upgrading formulas, we can get 
other, much better integer, wavelet transformations for image compression* Now, the key 
problem is: What kind of deductive formulas should be used? We provide an answer to this 
question in the following two sections, Section 4 and Section 5. 

4. Lifting Scheme and Integer Biorthogonal Filtering 

The Lifting scheme, discovered by Sweldens [ 1], is a new approach for constructing 
biorthogonal wavelets with compact support. However, the most interesting part of this method 
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for us is: it can be used, with minor modification, to create integer biorthogonal wavelet 
transformations. The following is an adaptation of the technique of 

Definition 1 . The set of filter {h, h, g, g) is a set of biorthogonal filters if the following formula 
is satisfied: 

Vo)€R m(a>>i! f (6>)si. 
where f*K(o) 



and Kco) = £ h^ 19 and g(c?)« £ g k e 

and similarly for m(o). h{&) and g(co) . 

The following lemma is the main result of the lifting scheme [1] reported as corollary 6 in 
that paper. 

Lemma 1. Take an initial set of finite biorthogonal filters {h, h° f g°>g} t then a new set of 
finite biorthogonal filters {h, h , g, g) can be found as 

«(»)«i 0 (©)-MoW2»)- 
Similariy.if we take {&° ( ft, g, g°J as an initial set of biorthogonal filters, anew set of finite 
biorthogonal filters {h 9 h 7 g,g] can be found as 

h(Q)) = h\&)+g(a)T&ofi 

(4.1b) 

Here, s(qj) is a trigonometric polynomial and the corresponding filter s is finite l and so is . 
Actually, regarding the filters, (4.1) is equivalent to 

o ' (4.2a) 



/ 

8t - "XVj?* 



or - _. (4.2b) 



Next, we use the lifting scheme with minor modification to create an integer, nonlinear, 
quasi-biorthogonal, wavelet algorithm. Suppose {cj} is a original signal, {c^} and {<*i}are 
again its low and high frequency decomposition parts, obtained by using the filters [h, h , g, g) . 
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If wc use filters {h , g } for decomposition (analysis), the corresponding decomposition algorithm 

'c\ =a c %c?h H „ 2kt 



is 



While the reconstruction algorithm will be 

related to the synthesis filter {A, g } , Here, parameters a f and a, are positive constants with 
a c • a, = 2. For example, in the situation of regular biorthogonal decomposition and 
reconstruction, a c - a 4 = ^2 ; and for Example 1 through Example 5 above, <x c = 1 and a 4 ^ 2 . 

If the set of filters {A, A, g} is from {A, h\ g°, g] by (4.2b), then the decomposition 
can be accomplished as follows: 



1. 



Calculate 



2. Calculate 
The relative reconstruction scheme will be; 



or.. 



(4.3) 
(4.4) 



1, 



Calculate 



(4.5) 



2. Calculate 



f 'Ml j\„Q \ 



(4-6) 



Here, equations (4.3) and (4.6) are just the wavelet ( inverse ) transforms using biorthogonal 
filters {A, A 0 , g°, g J . While (4.4) and (4.5) are forward and backward upgrading formulas. 

Similarly, if the set of filters {A, A, g, g] is from the initial set of filters [h\ A, g, g 0 } 
by using (4.2b), the relative decomposition is: 



Calculate 
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2. Calculate 4=4°-^2>U. 
The reconstruction scheme is: 

1. Calculate d? = d^SL^^t 



2. Calculate c* = 2£ 



For the sake of clarity, we haven't considered the boundary situation, but we will address this 
later. 

Corollary 4. ] . Suppose biorthogonal filters \h, h, g, g) arc from initial filters [h, h\ g\ g] by 
the lifting scheme (4.1a) or (4.2a). If the decomposition and reconstruction by filters 
!*• *°> *} can be accomplished only by integer calculation, such as Example 2, we also can 
create a corresponding integer wavelet decomposition and reconstruction scheme which is very 
"close" to the original one by using filters [h, h.g.g}. Here the word "close" means that the 
difference of the two decomposition schemes is just some rounding error, and this rounding error 
will be corrected bj^the integer reconstruction scheme. 

In fact, if {c| 0 } and {d\ }are integer after (4.3), we can calculate {c{ } by 



(4.7) 



instead of (4.4). Here Int(x) , as described in Section 2, is an arbitrary rounding up function 
which satisfies x - 1 S Int(*) S x + 1 . It is obvious that (4.7) is very "close" to (4.4)! and the exact 
reconstruction scheme can easily be obtained from 



(4.8) 



and (4.6). There will be a similar result, if the set of biorthogonal filters [h, h, g, g) is obtained 
from the initial set of filters [h°, h, g, g°) by using (4.2b). 

We can now note, except for the example shown in the Lazy wavelet, (Example 2) most 
standard biorthogonal wavelet transforms cannot be performed directly by integer, even for one of 
the simplest wavelets, the Hoar wavelet. However, if we properly choose the parameters a r and 
a< , and slightly change the transform algorithms, such as Example 1 and Example 3, we can have 
a variation of the original biorthogonal wavelet transforms with respect to the set of filters 
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{A, g° t g) (or {A 9 , A, $, | 0 }). On the other hand, the parameters {j, } should be also 
chosen carefully to guarantee that only addition and shift operations are needed by the algorithm. 

Another observation: if the set of filters {h, h , g y g) is obtained from a set of filters 
{h° t h % g t g Q } by the lifting scheme, and the set {h°, h % g> g 0 } is also obtained from a filter set 

h Q f g°> | 0 } , we can Tepeatedly use Corollary 1 to get a "close" integer wavelet 
transformation. 

5. The Correction Method for Creating Integer Wavelet Transforms 

In this section, we will describe another approach for obtaining integer wavelets by using 
the so called Correction method. The motivation of this method is from the S+P transform, and 
we will now generalize this approach. Actually, the lifting scheme for generating biorthogonal 
wavelets can be considered as a special case of the correction method. From this method we can 
get some even complicated filters with fast decomposition and reconstruction algorithm. 

Suppose that we already have a simple integer wavelet transform, such as Examples 1 
through 3, the decomposition and reconstruction scheme of which can be formulated as follows: 

Decomposition WJo\\ (5 '° 

Reconstruction <J » rf (fc °}{# 0 J (5.2) 

Here, (5*1) and (5.2) can be the same as (4,3) and (4.6) or other algorithms. 

In general, after the above decomposition, one may not be satisfied with the result. Them 
may still be some correlation among the highpass components because of the aliasing from the 
lowpass components, or the lowpass components do not carry enough of the expected information 
from the original signal. Hence, we could make an improvement by putting some correction part 
on the highpass components or lowpass components. There are many ways to accomplish this. 
However> for the sake of the integer calculation, we prefer to use following connection method. 
For example, if we want to make a correction for the highpass part, the corresponding formula 
would be: 

d[ s</J-°-Int(ifci) k= - 0, 1, 2,-'. (5.3) 
Here, dc\ is a correction quantity for d\ 

<te\ =^^ + £r ; <^ k »• **, 0 , 1 • 2, • (54) 
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and, {cr ( ^ and ^ arc given parameters which have been chosen for the user's purpose, 

such as reducing the redundancy among bighpass components or some other special requirement 
We are not going to discuss how to choose these parameters, but one can refer to the references [3, 
5, 6} for clarification of thiiprocew, The only thing we need to mention is, for the Mke of the 
integer calculation, any entries in both {^jf^ and ^ should be rational numbers with 

denominators being powers of 2. 

Rom (5.1), (5.3) and (5.4), it is easy to see the perfect reconstruction algorithm can be 

dl* = rfJ+Im(dfc 4 )k=--% m, m-l,m-2-, (5.5) 

combined with (5.2). 

As mentioned above, the Lifting scheme is a special condition of the Correction method. 
Examples 3 through 5 can also be considered as the examples of this method. We next give an 
example of the Correction method which cannot be included in the group of Lifting scheme, and 
also which does not result in a closed form of compact support for biorthogonal filters, 



R<*TTmi» * S+P transform [3], which is similar to using following 



n 


-2 


-1 


0 


1 


2 


3 


h. 


0 


0 


1/2 


1/2 


0 


0 


X. 


-1/16 


-1/16 


15/32 


-17/32 


7/32 


-1/32 



analysis filters 



While, the synthesis filters do not have compact support. However, the S+P transform can 
be implemented as follows: 
(a) Decomposition 

(1) Take the decomposition step of Example 1 , that is, compute 



and 



1.0 



2 



Int(- " ■ " ■ ■) + « if ^ is an even number, 



if N is an odd number. 



(2) Correction Step: Define 5 0 - -i, s l = l , 1*1 and 
and now compute 
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(b) Reconstruction 
(1) Compute 



4° = 4 + I„t(i!L^L )< 



(2) If /V is an even number, compute 



,4 



or, UN is an odd number, we have 



(3) Compute 



6. Boundary Conditions 

In the previous two sections, we did not show how to get the integer, wavelet transform at 
the boundaries of signals. However, for all of the examples given above, the boundaries have 
been considered. There are two issues dealing with boundary filtering if we use the Lifting scheme 
or the Correction method to generate the integer wavelet transformations. The first is how to 
process the boundaries which occur in the start-up wavelet transformations. The second is how to 
deal with the boundaries in the deductive formula If the boundaries in the start-up wavelet 
transform have already been established, then those in the upgrading formula are easy to establish. 
In fact, for the Lifting scheme, the boundaries in both steps should be processed in the same way. 
While, for the Correction method, it is easy to see from (5.3)-(5.4) that one has more choices to 
process boundaries in the second step. Therefore, the only thing we need to discuss here is the 
process by which the boundaries in the start up wavelet transformations are established. Assume 
we begin with compact supported biorthogonal wavelets. 
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Suppose the original signal is \cj}_ 0 . For creating integer biorthogonal wavelet 

transformations we can use the following symmetric extension [7]; 

( 1 )* If current biorthogonal filters have even length, we extend 
the boundaries of the signal as c^*cf^ t k»l,2;*s 

(2). If the filters have odd length, we do the extension as c% = c° t k ■ 1 ,2r • 
Example 1 through 5 use the boundaries give above. In Example 6, the start up wavelet 

transform uses the above boundaries, but in the upgrading step, another boundary filtering is used. 

In addition, for arbitrarily sized images or signals, one can use the same technique which we 

described in the above examples to deal with this condition. 

7* Some Applications 

Before talking about any applications of the integer wavelet transform given above, we first 
prove that a nice property of precisian preservation (PPP), which is similar to the one mentioned in 
Section 2, holds for both the Lifting and Correction upgrading technique. This property is very 
important for many applications. 

T.ftTnma 7.1 Suppose that our integer wavelet transform starts with a pair of biorthogonal filters 
with the PPP property discussed in Section 2, that is» (4.3) and (4.6) possess this property. Then, 
the same property will be preserved in the whole algorithm if we adopt the Lifting scheme to be 
the upgrading formula. 

In other words, Lemma 7.1 states if we only use the working units with the same precision as the 
original signal or image to calculate die wavelet transform developed in Section 4, the equations 
(4.8) and (4.6) are still the backward operations of the equations (4,3) and (4.7). 
Proof. Assume that we only use q bits to represent images or signals, say, the range of the pixel 
values is within [-2*"*, 2*" 1 - 1] . According to the hypothesis of the lemma, the equations (4.3) 
and its inverse (4,6) have the PPP property. Therefore, what we have to verify here is that the 
equation (4.7) and its inverse (4.5) can preserve the same property. We rewrite (4.7) and (4.8) as 
follow: 

ci=cV°+* A , an 

and its inverse 

cJ*=ci-V (7.2) 

Here, 
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In fact, the quantity b k would have the same value in both (4.7) and (4.8) if we calculate it 
in the same way. On the other hand, if the working unit for b k is q bits, the machine will give b k 
another value, say b k ( - 2*" £ b k < 2^ ), where b k is not equal to b k in the sense of 
mathematics if the value of ^ is beyond the interval [-2 q ~ l , 2 H - 1] . However, ^ will be the 
same in both (4.7) and (4.8), Therefore, the machine will automatically implement (7.1) and (7.2) 
as 



and 





if •2"- , <c , 4 - 0 + i t <2«-«, 






if c' t ° + £, >2«"', 


(7.1ra) 




if c^ + t^-Z*' 1 . 






if -2*-' <ci-6 t <2«-'. 






if c^-£ t <-2«-\ 


(7.2m) 




if c;-£ t *2 vH . 





It is easy to see that (7,2m) is just the backward operation of (7.1 m), which provides the evidence 
that the conclusion of this lemma is correct 

It should be mentioned that the coefficients {c[ } obtained by (4.3) and (7. lm) might not be 

the "real" wavelet coefficients using common sense. However, if we still use the working unit 
with q bits precision at the reconstruction step, (7,2m) and (4.6) will give the exact original signal 
back. On the other hand, the coefficients {cj } still keep the most continuity of the "real" wavelet 

coefficients. Therefore, when we repeat the decomposition step on {cj }, most small coefficients 
in its high frequency part {d* } will be almost the same as the "real 11 coefficients (within some 
rounding error), which allows us to still take advantage of the "real" wavelet transform in image 
compression. 

A similar argument can show the same PPP property will hold for the integer wavelet 
transforms generated by the Correction method in Section 5. 

As we mentioned before, for many applications, the lossless image compression is as 
; important as lossy compression. The integer wavelet transforms give the opportunity to compress 
without loss. It is also obvious that the integer wavelet algorithms can be used wherever ordinary 
j wavelets are used, especially in signal and image compression. However, for most computers, the 
; integer wavelet transform is much faster than the ordinary one and it uses much less memory. 
The following are some applications illustrating these types of transforms. 

i 
I 

i ' 



Chao-Fisher 15 



MAR-1 1-1997 12^25 



CIS 



P. 26 



Application 1. Lossless image compression 

As mentioned at the beginning of this paper, the integer wavelet transformation 
established by the techniques described in this paper can always be used for lossless image 
compression because of the reversible ability. Especially, we can use the PPP property 
discussed in Lemma 7.1 . We have used this wavelet lossless technology (WLT) for gray 
scale lossless image compression, and we have tried several images. For most natural 
images, the size of wavelet lossless compressed images is much smaller than corresponding 
GIF images. Figure 1 through 4 give some examples. Figure 1 is a standard image for 
compression, Figure 2 and 4 are X-ray images and Figure 3 is a two-value image but we treat 
it as a 8 bit gray scale image in order to compare with the GIF format In fact, if we convert 
Figure 2 to a binary image, better result can be obtained by the JBIG technique. 




(512x512) 
Figurvi Compression Ratio 
WLT: 1.9:1Aj1F:1 05 1 



(512*512) 
Figure?. Compression Ratio: 
WLT4.5:1/GIF: 2.72;l 



"Visioneer may have come up with on 
against the paper blizzard. . .gets piles 
way to others throughout your compar 



Figure 3. Compression Ratio: WLT: 20.8/ GIF 17.8 (152x794) 
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Figure 4. Compression Ratio: WLT 3,8:1/G1F 1.98:1 (1232*1024) 

Application 2* Large scale medical image compression 

Usually, 12 bits are used to represent one pixel in medical images. In this situation, the 
values of the pixels vary from 0 to 4095. Such images require careful treatment when a 
transform coding method is used for compression. If we use ordinary biorthogonal wavelets, 
the range of the transform coefficients will expand to [-2 1 *, 2 16 ] when five levels of transform 

are used Therefore, a longer working unit has to be employed, which consumes significant 
■ computer resources. However, the integer wavelet technique developed in this paper will solve 
this problem. For example, if we use the transforms given in Example 3, 5 and 6, the values 
of transform coefficients will be limited to the range of (-2 1 \ 2 1 3 ] * Even if we do not use the 
PPP property for these wavelets, 16 bits for the working unit is sufficient for ail computations. 

8* Conclusion 

This paper has shown the processes necessary in order to obtain a non-linear, integer, 
biorthogonal, or non-biorthogonal reversible wavelet transform suitable for signal or image 
processing. We have shown how such a transform can be obtained either using the Lifting 
method, or the Correction method. For example, all interpolation wavelets can be modified to be 
corresponding integer wavelets without loosing any properties of original wavelets. In addition, 
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we have shown under certain conditions, the precision of the transform computation on the 
computer can remain at the same precision of the data, thus reducing the need for additional 
computer memory during the transform computation. These are extremely powerful techniques 
when the target data are large images, or the requirements establish a need for speed. 

Although this paper establishes the structure for the integer transform based upon the 
biorthogonal wavelet or some non-biorthogonal wavelet, we do not imply the examples in this 
paper are necessarily the best wavelets for any particular application. However, we do claim if 
one is going to use such a technique, the ideas suggested in this paper will provide the best 
implementation. 
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image quality while the rest of the image is compressed 
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Post Reconstruction Filters* Filter* arc available to 
enhance tbe reconstructed image. At compression time 
the user can preset a control to have these filters operate 
automatically during reconstruction. Tbe filters include; 
quality improvement, sharpen (edge enhancement), 
smoothing, and brighten. 

Transparencies. The user will have the ability to set 
pixels transparent so that a color in the background 
(already on the page) can be seen through the picture. 
This is useful for creative web site developers. 
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to compress images with minimal input, requiring only a 
decision between more quality or more compression. An 
ADVANCED mode enables the user to select; 1) image 
file size, 2) compression ratio, 3) PSNR, or 4) master 
level. Web designers will like the one step process to 
control the size of their image files, thus insuring the 
speed an image may be viewed on a browser, 
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to the specified compression ratio, in this way impfjriant 
pans of a picture maintain crucial details while the over 
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Transparencies. The user will have the ability to set 
pixels transparent so that a color in the background 
(already on the page) can be seen through, the picture. 
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Progressive Compression. An image can be compressed 
so that when it is viewed it will appear quickly, first with 
low resolution, and then progressively building up in 
detail as it is downloaded. This insures the viewer does 
not loose interest while the image is downloaded. 



MftR-04-1997 14:29 INFINITRON IN 

I N F I N I T RO N 




Ahout INFINITRON. Inc. 

Founded in 1992, INFINITRON, Inc. is a private 
company that specializes in the design and marketing of 
high quality image and video compression solutions for a 
wide array of markets. INFINITRON is based in 
Vancouver, BC with labs in Regina, Saskatchewan and 
Denton Texas. 



IONAL 604 6889798 P. 03/09 

winaows image 
Compressor V3.0 




Lenna, JPEG 1 1 5: 1 Compression 



l»pfic*f tas Ughfilns SMkt Iftige Ctcnonsslw 

• Images on the Web 

• Photo Stock, 

• Data Warehousing 

• Catafoqucs. 

» Video Games 

• CDs (Encyclopedias, Museums, Science, and Medicine) 

• Archives (Art, History, Genealogy) 

• Medical Imaging 

Pirftrmiice 

Encode time typically less than 3 seconds for a 320 x 240 
pixel, 24 bit color image on a 133 MHz. Pentium with 1 6 MB 
RAM 

MlnimtiM ReciMmtidii Sysiim 

Window* 95/NT OS 

Pentium 1 00 MH*. 8 MB RAM 

2 MB for program files 

10 MB plus to swap image files 

Kncllin INHNmiM Products 

» Netscape Navigator Plug-in 

» Java Applet 

• ActiveX Control 

• Web Site Image Coovener 

• Lightning Strike SDK 

• GMT. Banner Generator 




Download a FREE demo version of Lightning Strike Windows Compressor from: 

www.infinitron.com 



INFINITRON 
USA Office 

INFINITRON 
Canada Office 



3401 East University, #104, Denton, TX t 76208 
Tel: 817.484.1 165 FAX: 817.484.0588 

10* Fir 1 199 W. Hastings, Vancouver, RC, V6E 3T5 
Tel: 604.688.9789 FAX: 604.688.9798 



MAR-04-1997 14:31 I 



INF IN I IRON INTERNATIONAL 



604 6889798 P. 04/09 



INFINITRON 

Lightning Strike 




Product Fact Sheet 

Windows Compressor 



'./:• Compnwsor Version 3.0 

The Lightning Strike Compressor is a Window* tool that compresses still images from a wide 
variety of digital image formats using Infinitron's proprietary Wavelet algorithm. Images can 
be compressed to files 5 times smaller than JPEG, while maintaining similar or better image 
fidelity. Images can be viewed tn I or 2 seconds over the internet rather than 10 to 20 
seconds for images compressed under JPEG. This has enormous benefits for transmitting 
over corporate networks or the web, and in addition, saves space required for storing alj those * 
images. 

Lightning Strike is a collection of tools in a user friendly environment Two levels of user 
control are offered, one quick and easy for most applications, the other a master level for the 
advanced user who wishes to control parameters to maximize image quality. 

The compression approach used by Lightning Strike is based upon integer wavelets. This 
technology is acknowledged by leading experts as a superior compression technique as 
compared to discrete cosine transform used in JPEG, 



Image Compression Options and Control 

Compression Technique Options 

Both Infinitron's Wavelet Compression and other frequently used compression methods are 
included in the product so users need only have Lightning Strike on their work station to 
perform all image compressions. Images can be compressed to Wavelet, JPEG, PNG, and 
GTR 

Compression Quality Versus Speed Options 

The user can select one of two encoding processes that trade quality for speed of compression 
and ease of use. With the -Advanced" option selected, the optimum compression parameters 
are set by the user to give the best possible images for selected compression ratio. With 
"Easy" selected you get the fastest compression without having to know details of parameter 
selection. 

Compression Ratio Control 

The co mpressed image file size or compression ratio may be specified rather than the quality 
factor. This enables a web designer to control the size of their image files or the speed an 
image may be viewed, in a one step process. 

Region of Interest Focusing 

Regions of an image can be selected for less compression to preserve a higher image quality 
while the rest of the image is compressed to the specified compression ratio. In this way 
important parts of a picture maintain crucial details while the over all picture file can be made 
as small as possible. This is also known as Non-Uniform Compression. 
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Split and Merge 

Very large images, which could not otherwise be compressed due to their large size, can be 
split into smaller images and compressed individually. This process has the side advantage of 
using RAM more effectively speeding time for compression. The split image* can be 
reassembled using the merge aspect of the feature. 

Post Reconstruction Filters 

Filter* arc available to enhance the reconstructed image. At compression time the user can 
preset a control to have these fillers operate automatically during reconstruction. The filters 
include; quality improvement, sharpen (edge enhancement), smoothing, and brighten. 

Transparencies 

The user will have the ability to set puds transparent so that a color in the background 
(already on the page) can be seen through the picture. This is useful for creative web site 
developer*. This gives the ability to display pictures other than the rectangular shape allotted 
on the web page, It. circles, polygons etc.. Also, designers often use this feature for 
shadowing, letters and objects. 

Progressive Decompression 

An image can be compressed so that when it is viewed it will appear quickly, first with low 
resolution, and then progressively building up in detail as it is downloaded. This insures the 
viewer does not loose interest while the image is downloaded. 



Draft 



Page:z 



Date: 01/26/97 



MAR-04-I997 14:31 



I NF I N I IRON INTERNATIONAL 



INFINITRON 

Lightning Strike 




604 6889798 P. 06/09 

Product Fact Sheet 

Windows Compressor 



Image Comparisons 



Picture of Lena, with no Compression (512X512 Image) 
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Picture of Lena Compressed 100:1 with Lightning Strike 




MAR-04-1997 14:32 INFINJTRON INTERNATIONAL 



INFIN1TRON 

Lightning Strike 




Draft 



Page: 4 



Osts: 01/28/97 



MAR-04-1997 14:33 I 



INFINITRON INTERNATIONAL 



684 6889798 P. 08/09 



Lightning Strike 



INFINITRON 




Product Fact Sheet 

Windows Compressor 



PNG File Structure 

The compressed images ire stored in file format compliant with the PNG standard. In the 
future this file format will replace the GIF format used today. 

Batch Compress 

The user is able to compress many images at once by adding or deleting image file* (or paths) 
to a list box. 

Image Statistics 

The compressor stores image statistics on each compressed image which may be viewed by 
the user. The following information is provided; image dimensions, compression ratio, file 
si26S, MSE, PSNR, maximum pixel difference, compression and decompression times. 




Encoding and Decode Time. 

The typical time to encode or decode a 320X240, 24 bit color image is I second on a Pentium 
running at 133 MHz with 16 Meg RAM. 

Minimum Recommended System 

The minimum system requirements for an IBM PC Compatible are: 

Hard Disc Drive 2 Mbytes tree for program files, 10 Mb plus to swap 
image Files. 

Operating System MS Windows 3.1(Win32)/ 95/ NT 
RAM 8 Mbytes 

This software is also available on the Apple MAC, Solaris, and UNIX platforms. 
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-. Andll^inllnidwi Products 
Netscape Navigator Plug-In 

Netscape plug-ins arc available for the Mac68k, Mac PPC. Widows 3.1 and 95ftn. 



Java Applet 

Java Applet* arc available for the Mac68k, Mac PPC, Widows 3, 1 and 95/NT. 
ActiveX Control 

The Lightning Strike decompression software is available for such applications as Microsoft's 
Internet Explorer, as an ActiveX control. 

Web Site Image Converter 

This utility will automate the conversion of web pages from JPEG to the Lightning Strike 
format The utility searches an HTML file and replicates It replacing any JPEG image tag* 
with Lightning Strike tags and converting the JPEG image Hies to Lightning Strike. The 
utility can follow link tags to recursively convert and replicate an entire web site or sub- 
section of a web site to the Lightning Strike format This utility will be available for 
Windows NT and most flavors of the UNIX operating system. 

Lightning Strike Software Developers Kit 

Using the SDK, a developer can integrate the highly efficient Lightning Strike module 
libraries into their own application*. 



Download a FREE demo version of Lightning Strike Windows 
Compressor from: www.infmitron.com 
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I N F I N ! T R O N Windows Image 

Compressor V3.0 



Announcing, Lightning Strike™ Image Compressor (LSIC) version 3.0, a Windows 95 tool that 
compresses still images from 20:1 to 200:1 using INFINITRON's proprietary wavelet technology. LSIC 
is a versatile, easy to use tool for Web and Graphic designers that can handle a wide variety of digital 
image formats, and it includes filters and convenient web tools. Images can be compressed at ratios well 
in excess of present JPEG ratios while maintaining comparable image fidelity. This translates to much 
shorter image down load time on the web. This has enormous benefits for reducing bottlenecks on 
corporate networks and the web, and in addition, requires less storage space. 
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Compression. Uses a proprietary integer wavelet 

Compression Control. An EASY mode allows the user 
to compress images with minimal input, requiring only a 
decision between quality and compression. An 
ADVANCED mode enables the user to select; 1) image 
file size, 2) compression ratio, 3) PSNR, or 4) master 
level for professionals where every parameter can be 
altered. We also provide the highest, wavelet lossless 
compression for users wishing this capability. Web 
designers will like the one step process to control the size 
of their image files allowing control over the delivery 
time of an image over a network. 

Non Uniform Compression. Regions can be selected for 
less compression to preserve image quality while the rest 
of the image is compressed to the specified compression 
ratio.. In this way, important parts of a picture maintain 
crucial details while the over all picture file can be made 



as small as possible 

Post Reconstruction Filters. Filters are available to 
enhance the reconstructed image. At compression time 
the user can preset a control to have these filters operate 
automatically during reconstruction. The filters include; 
visual quality improvement, sharpen (edge 
enhancement), smoothing, and brighten. 

Transparencies. The user will have the ability to set 
pixels transparent, so that a color in the background 
(already on the page) can be seen through the picture. 
This is useful for creative web site developers. 

Progressive Compression. An image can be compressed 
so that when it is viewed it will appear quickly, first with 
low resolution, and then progressively building up in 
detail as it is downloaded. This insures the viewer does 
not lose interest while the image is downloaded. 
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Cow, Bitmap, No Compression 




Cow, Lightning Strike, 85:1 compression 



About !MFI1!TI0I, lac. 

Founded in 1992, INFINITRON, Inc. is a private 
company that specializes in the design and marketing of 
high quality image and video compression solutions for a 
wide array of markets. INFINITRON is based in 
Vancouver, BC with offices in Regina, Saskatchewan and 
Denton Texas. 




Cow, JPEG 85:1 Compression 

AcnQcatttDS (tr Ugtttoioa Strifci tasigt CtaprttsiM 

Images on the Web 
Photo Stock 
Data Warehousing 
Catalogues 
Video Games 

CDs (Encyclopedias, Museums, Science, and Medicine) 
Archives (Art, History, Genealogy) 
Medical Imaging 

PtrUrmaflci 

Encode time typically less than 2.5 seconds for a 640 X 480 
pixel, 24 bit color image on a 133 MHz. Pentium with 16 MB 
RAM. Decode time is less than .75 seconds. 

Minimum Itcimmiadil Systim 

Windows 95/NT OS 

Pentium 100 MHz, 8 MB RAM 

2 MB for program files 

10 MB plus to swap image files 

Ancillary MrllintON Products 

Netscape Navigator Plug-in 
Java Applet 
ActiveX Control 
Web Site Image Converter 
Lightning Strike SDK 
GML Banner Animation/Compression 
Black and White Image Compression 




Download a FREE demo version of Lightning Strike Windows Compressor from: 

www.infinitron.com 

INrTNITRON 3401 East University, #104, Denton, TX, 76208 
USA Office Tel: S17.4S4.1165 FAX: 817.4S4.05S6 

INFINITRON 10 th Fir 1 199 W. Hastings, Vancouver, BC, V6E 3T5 
Canada Office Tel: 604.688.9789 FAX: 604.688.9798 
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1. A method for compressing an image, 
comprising the steps of: 

performing a wavelet transformation of the 

5 image; 

quantizing the wavelet transformed image; 
applying entropy coding to the quantized image; 

and 

outputting a file that includes the entropy 
10 coded image. 

2. The method of claim 1, further comprising 
the following step: 

performing a color transformation of the image. 

3. The method of claim 1, further comprising 
15 the following step: 

performing the wavelet transformation using an 
integer wavelet transform. 

4. The method of claim 3, further comprising: 
deriving the integer wavelet transform using a 

20 lifting scheme. 

5. The method of claim 3, further comprising: 
deriving the integer wavelet transform using a 

correction method. 

6. The method of claim 1, wherein the step of 
25 quantizing includes the sub-step of: 

processing the wavelet transformed image using sub-band 
oriented quantization. 

7. The method of claim 1, further comprising: 
comparing the wavelet transformed image to at 

30 least one predetermined threshold value. \ 
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8. A method for wavelet-based image compression 
using reduced color components, comprising the steps of: 

creating a color table for an input image having 
a plurality of pixels; 
5 calculating an index for each of the pixels, 

whereby generating a plurality of indices; 

performing a wavelet transformation on the 

indices; 

applying entropy coding on the transformed 

10 indices; and 

outputting a file that includes the entropy 

coded indices. 

9. The method of claim 8, further comprising: 
dithering the pixels to generate the indices. 

15 10. The method of claim 8, further comprising: 

partitioning a large image into a plurality of 
small images to produce the input image. 

11. The method of claim 10, wherein the large 
image is selectively partitioned. 

20 12. An image processing system, comprising: 

means for performing a wavelet transformation on 
an input image; 

means for quantizing the wavelet transformed 

image; 

25 means for entropy coding to the quantized image; 

and 

means for outputting the entropy coded image. 

13. The image processing system of claim 12, 
further comprising: 
30 means for receiving the entropy coded image; 

means for entropy decoding the received image; 
means for de-quantizing the decoded image; and 
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means for performing an inverse wavelet 
transformation on the de-quantized image to produce an 
output image . 

14. The image processing system of claim 12, 
further comprising: 

means for displaying the output image. 

15. The image processing system of claim 12, 
further comprising: 

means for transmitting the entropy encoded image 
over a communications medium. 

16. An image compression system, comprising: 

a compressor configured to generate a compressed 
image based on an integer wavelet transform derived using 
a technique selected from a lifting scheme and a 
correction method. 

17. The image compression system of claim 16, 
wherein the compressor quantizes a wavelet transformed 
image to produce the compressed image. 

18. The image compression system of claim 16, 
wherein the compressor entropy encodes a quantized image 
to produce the compressed image. 

19. The image compression system of claim 16, 
wherein the compressor performs a color transformation to 
produce the compressed image . 

20. An image decompression system, comprising: 
a decompressor configured to generate a 

decompressed image based on an integer inverse wavelet 
transform derived using a technique selected from a 
lifting scheme and a correction method. 
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21. A computer-readable memory storing a 
computer program for directing a computer system to 
perform image compression, wherein the computer program 
implements steps for performing a wavelet transformation 
5 of an input image, quantizing the wavelet transformed 
image, applying entropy coding to the quantized image, 
and outputting a file that includes the entropy coded 
image . 

22* A method of compressing a data file, 
10 comprising the steps of: 

performing a wavelet transformation of the data 
file to provide a series of wavelet coefficients; 

quantizing those wavelet coefficients which fall 
above a predetermined threshold value to provide a 
15 quantized series of wavelet coefficients; and 

compressing the quantized series of wavelet 
coefficients to provide a compressed data file. 

23. The method of claim 22 wherein the 
compressing step comprises the step of applying an 

20 entropy coding to the quantized series of wavelet 
coefficients . 

24. The method of claim 23 wherein the 
entropy coding is selected from the group of arithmetic, 
Huffman, run length and Huffman run length combined. 

25 25. The method of claim 23 further 

comprising the step of performing a color transformation 
of the data file prior to the wavelet transformation 
step . 



26. The method of claim 25 wherein the 

30 quantizing step comprises sub-band orientation 
quantization . 
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27. 



The method of claim 26 wherein the 



wavelet transformation step comprises integer wavelet 
transformation. 



comprising the step of filtering the data file prior to 
the wavelet transformation step. 



integer wavelet transformation comprises biorthogonal 
filter method, 

30. The method of claim 27 wherein the integer 
wavelet transformation comprises the correction method. 

31. A compressed data file comprising a wavelet 
transformation of a data file having a series of 
compressed, quantized wavelet coefficients, the quantized 
wavelet coefficients having a value above a predetermined 
threshold value to provide a quantized series of wavelet 
coefficients . 

32. A program for compressing a data file 
comprising: 

a routine for performing a wavelet 
transformation of the data file to provide a series of 
wavelet coefficients; 



coefficients which fall above a predetermined threshold 
value to provide a quantized series of wavelet 
coefficients; and 

a routine for compressing the quantized series 
of wavelet coefficients to provide a compressed data 



28. 



The method of claim 22 further 



29. 



The method of claim 27 wherein the 



a routine for quantizing those wavelet 



file. 
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Abstract of the Disclosure 

A wavelet-based image compression system and 
method are presented* Compression is accomplished by 
performing a wavelet transformation of an input digital 
5 image. The resulting wavelet coefficients are compared 
to a threshold value. Coefficients falling below the 
threshold are discarded. The remaining coefficients are 
quantized. The quantized coefficients are then 
compressed using an entropy encoding technique, such as 

10 arithmetic, run length, or Huffman encoding, or a 

combination of Huffman and run length encoding. The 
wavelet transform can be an integer wavelet transform 
derived using a lifting scheme or correction method, 
while the quantization scheme can be sub-band oriented. 

15 Input color image pixels can be reduced using a color 
table. In addition, color pixels can be transformed 
between color spaces prior to wavelet transformation. 
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Attorney Docket No.: 63345 
First Named Inventor: 

TTrmgyaTig rhan 



Application Number: 
Filing Date: Herewith 
Group Art Unit: 
Examiner Name: 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next 
to my name. 

I believe I am the original, first and sole inventor (if only one name is 
listed below) or an original, first and joint inventor (if plural names are 
listed below) of the subject matter which is claimed and for which a patent 
is sought on the invention entitled: 



SYSTEM AND METHOD FOR IMAGE COMPRESSION AND DECOMPRESSION 



(Title of Invention) 

the specification of which: 

(X) is attached hereto, or 



( ) was filed by an authorized person on my behalf on 

(Date) 

as United States Application Number „ 

or PCT International Application Number . , 

and was amended on (if applicable) ♦ 

(Date) 

I hereby state that I have reviewed and understand the contents of the 
above- identified specification, including the claims, as amended by any 
amendment specifically referred to above. 

I acknowledge the duty to disclose information which is material to 
patentability as defined in Title 37, Code of Federal Regulations, §1.56, 

I hereby claim foreign priority benefits under Title 35, United States 
Code, §119 (a) -(d) or §365 (b) of any foreign application (s) for patent or 
inventor's certificate, or §365 (a) of any PCT international application 
which designated at least one country other than the United States of 
America, listed below, and I have also identified below, by checking the 
box, any foreign application for patent or inventor's certificate, or any 
PCT international application, on this invention filed by me or my legal 
representatives or assigns and having a filing date before that of the 
application on which priority is claimed: 
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Prior Foreign Certified 

Application Foreign Priority Copy Attached 

Number (s) Country Filing Date Not Claimed Yes No 

□ □ □ 

NONE □ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 



□ Additional foreign application numbers are listed on a supplemental 
priority data sheet attached hereto. 

I hereby claim the benefit under Title 35, United States Code, §119 (e) of 
any United States provisional application (s) listed below: 

Provisional Application Provisional Application 
_ ; Number (s) Filing Date 

£ 60/040241 March 11, 1997 

UJ □ Additional provisional application numbers are listed on a supplemental 
priority data sheet attached hereto. 

Rj j hereby claim the benefit under Title 35, United States Code, §120, of 
^ any prior United States application (s) , or under §365 (c) of any PCT inter- 
U national application (s) designating the United States of America, listed 
UJ below and, insofar as the subject matter of each of the claims of this 
H application is not disclosed in the prior United States or PCT inter- 
im national application (s) in the manner provided by the first paragraph of 
ill Title 35, United States Code, §112, I acknowledge the duty to disclose 
jti all information known by me to be material to patentability as defined 
in Title 37, Code of Federal Regulations, §1.56, which became available 
between the filing date of the prior application (s) and the national or 
PCT international filing date of this application: 

Filing Date of 
Prior PCT U.S. or PCT 

Prior U.S. International International Patent Number 

Application Number Application Number Application (if applicable) 



NONE 



□ Additional U.S. or PCT international application numbers are listed on 
a supplemental priority data sheet attached hereto. 

As a named inventor, I hereby appoint the following registered practi- 
tioners, with full power of substitution and revocation, to prosecute 
this application and to transact all business in the United States Patent 
and Trademark Office connected therewith, and request that all corres- 
pondence and telephone calls in respect to this application be directed 
to FITCH, EVEN, TABIN & FLANNERY, Suite 900, 135 South LaSalle Street, 
Chicago, Illinois, 60603-4277, Telephone No. (312) 372-7842, Facsimile 
No. (312) 372-7848: 
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Registered 
Practitioner 

Morgan L. Fitch, Jr. 
Francis A, Even 
Julius Tabin 
John F. Flannery 
Robert B. Jones 
James J . Schumann 
R. Steven Pinkstaff 
James J. Hamill 
Timothy E. Levstik 
Joseph E. Shipley 
Bryant R. Gold 
Robert J. Fox 
Kenneth H. Samples 
Philip T. Petti 
John S. Paniaguas 



Registration 
Number 

17,023 
16,880 
16,754 
19,759 
20,135 
20, 856 
20,448 
19,958 
30,192 
31,137 
29,715 
27, 635 
25,747 
31, 651 
31,051 



Registered 
Practitioner 

Richard A. Kaba 
Karl R. Fink 
Donald A, Peterson 
James R. McBride 
James A* Sprowl 
Bruce R. Mansfield 
Jeannette M. Walder 
James J, My rick 
Mark A. Hamill 
Perry J. Hoffman 
James P. Krueger 
Mark W. Hetzler 
Timothy P. Maloney 
Thomas F. Lebens 
Steven S . Favakeh 



Registration 
Number 

30,562 
34,161 
18, 647 
24,275 
25,061 
29,086 
30,698 
25,901 
37,145 
37,150 
35,234 
38,183 
38,233 
38,221 
36,798 



I hereby declare that all statements made herein of my own knowledge are 
true, and that all statements made herein on information and belief are 
believed to be true; and further that these statements were made with the 
knowledge that willful false statements and the like so made are punishable 
by fine or imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code, and that such willful false statements may jeopardize 
the validity or enforceability of the application or any patent issued 
thereon . 
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Honcryang Chao 
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Denton. Texas 



(City and State for U.S. Residents; 
City and Country for others) 
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Denton. Texas 76201 
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Howard P. Fisher 
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United States 



Full name of sole or one 
joint inventor: 

Inventor ' s s igna ture : 
Date: 

Residence: 

Post Office Address: 



Paul S. Fisher 
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Denton. Texas 

(City and State for U.S. Residents; 
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34 Timberareen Circle 
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Post Office Address: 



Zevi Hua 



(Given names first, with Family name last) 



Denton, Texas 



(City and State for U.S. Residents; 
City and Country for others) 
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Denton. Texas 762 01 
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Peoples Republic of China 



